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1. Introduction 

The celebrated Kolmogorov-Arnol'd-Moser (or KAM) theorem finally settled the 
old question concerning the existence of quasi-periodic motions for nearly-integrahle 
Hamiltonian systems, i.e., Hamiltonian systems that are slight perturbation of an 
integrable one. In the integrable case, in fact, the whole phase space is foliated by 
invariant Lagrangian submanifolds that are diffeomorphic to tori, and on which the 
dynamics is conjugated to a rigid rotation. These tori are generally called KAM tori 



(see also Definition 3.1 1. On the other hand, it is natural to ask what happens to 
such a foliation and to these stable motions once the system is perturbed. In 1954 
Kolmogorov |3D] - and later Arnol'd |T] and Moser jlH] in different contexts - proved 
that, in spite of the generic disappearence of the invariant tori filled by periodic 
orbits, already pointed out by Henri Poincare, for small perturbations of an inte- 
grable system it is still possible to find invariant Lagrangian tori corresponding to 
^'strongly non-resonanf, i.e., Diophantine, rotation vectors. This result, commonly 
referred to as KAM theorem, from the initials of the three main pioneers, besides 
opening the way to a new understanding of the nature of Hamiltonian systems and 
their stable motions, contributed to raise new interesting questions, for instance 
about the destiny of the stable motions (orbits on KAM tori) that are destroyed 
by effect of the perturbation or about the possibility of extending these results to 
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systems that are not close to any integrable one. 

An answer to the first question did not take long to arrive. In 1964 V. I. Arnol'd 
[2] constructed an example of a perturbed integrable system, in which unstable 
orbits - resulting from the breaking of unperturbed KAM tori - coexist with the 
stable motions drawn by KAM theorem. This striking, and somehow unexpected, 
phenomenon, yet quite far from being completely understood, is nowadays called 
Arnol'd diffusion. This new insight led to a change of perspective and in order to 
make sense of the complex balance between stable and unstable motions that was 
looming out, new approaches needed to be exploited. Amongst these, variational 
methods turned out to be particularly successful. Mostly inspired by the so-called 
least action principle, a sort of widely accepted "thriftiness" of Nature in all its ac- 
tions, they seemed to provide the natural setting to get over the local view given by 
the analytical methods and make towards a global understanding of the dynamics. 

Aubry-Mather theory represents probably one of the biggest triumphs in this 
direction. Developed independently by Serge Aubry [3] and John Mather [38 in the 
eighties, this novel approach to the study of the dynamics of twist diffeomorphisms 
of the annulus (which correspond to Poincare maps of 1-dimensional Hamiltonian 
systems [49 J pointed out the existence of many action-minimizing sets, which in 
some sense generalize invariant rotational curves and that always exist, even after 
rotational curves are destroyed. Besides providing a detailed structure theory for 
these new sets, this powerful approach yielded to a better understanding of the 
destiny of invariant rotational curves and to the construction of interesting chaotic 
orbits as a result of their destruction |40| \T7\ H5] . 

Motivated by these achievements, John Mather |42[l44| - and later Ricardo Marie 
|35l [H] and Albert Fathi [22^ in different ways - developed a generalization of this 
theory to higher dimensional systems. Positive definite superlinear Lagrangians 
on compact manifolds, also called Tonelli Lagrangians (see Definition 2.1 1, were 
the appropriate setting to work in. Under these conditions, in fact, it is possible 
to prove the existence of interesting invariant (action-minimizing) sets, known as 
Mather, Aubry and Mane sets, which generalize KAM tori, and which continue to 
exist even after KAM tori's disappearance or when it does not make sense to speak 
of them (for example when the system is "far" from any integral one). 

Let us remark that these tools revealed also quite promising in the construction 
of chaotic orbits, such as for instance connecting orbits among the above-mentioned 
invariant sets |44[ \E\ [17] . Therefore they set high hopes on the possibility of proving 
the generic existence of Arnold diffusion in nearly integrable Hamiltonian systems 
|45| . However, differently from the case of twist diffeomorphisms, the situation 
turns out to be more complicated, due to a general lack of information on the 
topological structure of these action-minimizing sets. These sets, in fact, play a 
twofold role. Whereas on the one hand they may provide an obstruction to the 
existence of "diffusing orbits", on the other hand their topological structure plays a 
fundamental role in the variational methods that have been developed for the con- 
struction of orbits with "prescribed" behaviors. We shall not enter further into the 
discussion of this problematic, but we refer the interested readers to |51 1^ fTfl H51 H5] . 



In these lecture notes we shall try to to provide a brief, but hopefully compre- 
hensive introduction to Mather's theory for Lagrangian systems and its subsequent 
developments by Ricardo Marie and Albert Fathi. We shall consider only the au- 
tonomous case (i.e., no dependence on time in the Lagrangian and Hamiltonian). 
This choice has been made only to make the discussion easier and to avoid some 
technical issues that would be otherwise involved. However, all the theory that we 
are going to describe can be generalized, with some "small" modifications, to the 
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non-autonomous time-periodic case. Along our discussion, in order to draw the 
most complete picture of the theory, we shall point out and discuss such differences 
and the needed modifications. 

The sections will be organized as follows: 

• Section |2] we shall introduce Tonelli Lagrangians and Hamiltonians on 
compact manifolds and discuss their properties and some examples. 

• Section [3] before entering into the description of Mather's theory, we shall 
discuss a cartoon example, namely, the properties of invariant probabil- 
ity measures and orbits on KAM tori. This will prepare the ground for 
understanding the ideas behind Mather's work, as well Mane and Fathi's 
ones. 

• Section |4j we shall discuss the notion of action minimizing measures and 
introduce the first family of invariant sets: the Mather sets. 

• Section [5} we shall discuss the notion of action minimizing orbits and in- 
troduce other two families of invariant sets: the Aubry and Mane sets. 

• Section [6] we shall discuss Fathi's Weak KAM theory and its relation to 
Mather and Mane's works. 

• Some Addenda to the single sections with some complimentary material 
will be provided along the way. 

Acknowledgements. These lectures were delivered at Universita degli Studi di 
Napoli "Federico II" (April 2009, thematic program ^^New connections between 
dynamical systems and Hamiltonian PDEs'^) and at Universitat Politecnica de 
Catalunya (June 2010, summer school " Jornades d'introduccid als sistem,es dindmics 
i a les EDP's"). I am very grateful to, respectively, Massimiliano Berti, Michela 
Procesi, Vittorio Coti-Zelati and Xavier Cabre, Amadeu Delshams, Maria del Mar 
Gonzales, Tere M. Seara, for their kind invitation. I would also like to thank all 
participants to the courses for their useful comments, stimulating suggestions and 
careful feedbacks, in particular Will Merry, Joana Dos Santos and Rodrigo Treviho 
for a careful reading of a first draft of these notes. 

A special acknowledgement must go to John Mather, Albert Fathi and Patrick 
Bernard, from whom I learnt most of the material here collected and much beyond. 
I would also like to thank all other people that have contributed, in different ways 
and at different times, to the realization of this project: Luigi Chierchia, Gonzalo 
Contreras, Rafael de la Llave, Daniel Massart, Gabriel Paternain and many others. 



2. Tonelli Lagrangians and Hamiltonians on compact manifolds 

In this section we want to introduce the basic setting that we shall be considering 
hereafter. Let M be a compact and connected smooth manifold without boundary. 
Denote by TM its tangent bundle and T* M the cotangent one. A point of TM will 
be denoted by {x,v), where x G M and v e T^M, and a point of T*M by {x,p), 
where p £ T* M is a linear form on the vector space T^M. Let us fix a Riemannian 
metric g on it and denote by d the induced metric on M; let || • \\x be the norm 
induced by g on T^M; we shall use the same notation for the norm induced on 

We shall consider functions L : TM — > E of class C^, which are called La- 
grangians. Associated to each Lagrangian, there is a fiow on TM called the Euler- 
Lagrange flow, defined as follows. Let us consider the action functional A^ from 
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the space of continuous piecewise curves 7 : [a, b] — > M, with a < b, defined by: 

Ml) ■■= f L{j{t),j{t))dt. 

J a 

Curves that extremize this functional among all curves with the same end-points 
are solutions of the Euler- Lagrange equation: 

(1) = 1^^^^*)'^^^)) yt€[a,b]. 

Observe that this equation is equivalent to 

— (7W,7W)7W = a^(7W.7W)- ^(7W,7W)7(t), 

therefore, if the second partial vertical derivative d'^ L / dv^ {x , v) is non-degenerate 
at all points of TM, we can solve for 7(t). This condition 

is called Legendre condition and allows one to define a vector field on TA/, such 
that the solutions of 7(t) — XL(j{t),j{t)) are precisely the curves satisfying the 
Euler-Lagrange equation. This vector field Xl is called the Euler-Lagrange vector 
field and its fiow <i>f is the Euler-Lagrange flow associated to L. It turns out that 



$f is even if L is only (see Remark 2.4 1. 



Definition 2.1 (Tonelli Lagrangian). A function L : TM — > M is called a 
Tonelli Lagrangian if: 

i) Le C^iTM); 

ii) L is strictly convex in the fibers, in the sense, i.e., the second partial 
vertical derivative d'^ L / dv^ {x , v) is positive definite, as a quadratic form, 
for all {x, v); 

iii) L is superlinear in each fiber, i.e., 

L{x,v) 
hm — — - — = +00. 

||t;l|,^+oo \\v\\a: 

This condition is equivalent to ask that for each A G M there exists B{A) € 
M such that 

L{x,v)>A\\v\\-B{A) y{x,v)eTM. 

Observe that since the manifold is compact, then condition iii) is independent 
of the choice of the Riemannian metric g. 

Remark 2.2. More generally, one can consider the case of a time-periodic Tonelli 
Lagrangian L : TM x T — > M. (also called non-autonomous case), as it was 
originally done by John Mather |32]- In fact, as it was pointed out by Jiirgen 
Moser, this was the right setting to generalize Aubry and Mather's results for twist 
maps to higher dimensions; in fact, every twist map can be seen as the time one 
map associated to the fiow of a periodic Tonelli Lagrangian on the one dimensional 
torus (see for instance [49]). In this further condition on the Lagrangian is 

needed: 

iv) The Euler-Lagrange flow is complete, i.e., every maximal integral curve of 
the vector field X^ has all M as its domain of definition. 

In the non-autonomous case, in fact, this condition is necessary in order to have 
that action-minimizing curves (or Tonelli minimizers, see section [s]) satisfy the 
Euler-Lagrange equation. Without such an assumption Ball and Mizel |3] have 
constructed an example of Tonelli minimizers that are not and therefore are not 
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solutions of the Euler-Lagrange flow. The role of the completeness hypothesis can 
be explained as follows. It is possible to prove, under the above conditions, that 
action minimizing curves not only exist and are absolutely continuous, but they 
are on an open and dense full measure subset of the interval in which they are 
defined. It is possible to check that they satisfy the Euler-Lagrange equation on this 
set, while their velocity goes to infinity on the exceptional set on which they are not 
C^. Asking the flow to be complete, therefore, implies that Tonelli minimizers are 
everywhere and that they are actual solutions of the Euler-Lagrange equation. 
A sufficient condition for the completeness of the Euler-Lagrange flow, for example, 
can be expressed in terms of a growth condition for dL/dt: 

dL ( dL \ 

- — (x,v,t) < C 1 + —(x,v,t) - v- L(x,v,t) y{x,v,t) G TM x T. 
at \ ov J 

Examples of Tonelli Lagrangians. 

• Riemannian Lagrangians. Given a Riemannian metric g on TM, the 
Riemannian Lagrangian on (Af , g) is given by the Kinetic energy: 

L{x,v) = \\\v\\l. 

Its Euler-Lagrange equation is the equation of the geodesies of g: 

D 

Jt^^'^ 

and its Euler-Lagrange flow coincides with the geodesic flow. 

• Mechanical Lagrangians. These Lagrangians play a key-role in the study 
of classical mechanics. They are given by the sum of the kinetic energy and 

a potential U : M — > M: 

L{x,v) = \\\v\\l^U{x). 
The associated Euler-Lagrange equation is given by: 

j^x = VC/(x) , 

where VU is the gradient of U with respect to the Riemannian metric g, 
i.e., 

d^U -v = {VU{x),v)^ y{x,v)€TM. 

• Mane's Lagrangians. This is a particular class of Tonelli Lagrangians, 
introduced by Ricardo Mafie in (see also [23]). If X is a C*^ vector field 
on AI, with k > 2, one can embed its flow (p^ into the Euler-Lagrange flow 
associated to a certain Lagrangian, namely 

Lx{x,v)^^\\v~X{x)\\l . 

It is quite easy to check that the integral curves of the vector field X are 
solutions to the Euler-Lagrange equation. In particular, the Euler-Lagrange 
fiow <I>f^ restricted to Graph(X) = {{x,X{x)), x e M} (that is clearly 
invariant) is conjugated to the flow of X on M and the conjugation is given 
by 7r|Graph(X), where tt : TM — > M is the canonical projection. In other 
words, the following diagram commutes: 

Graph(X) -^-^ Graph(X) 



M ^M 

ft 
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that is, for every x £ M and every t e M, <^^''{x,X{x)) = (7^ (t), 7^ (i)), 
where 7^(t) = ^ti^)- 

In the study of classical dynamics, it turns often very useful to consider the as- 
sociated Hamiltonian system, which is defined on the cotangent space T*M. Let us 
describe how to define this new system and what is its relation with the Lagrangian 
one. 

A standard tool in the study of convex functions is the so-called Fenchel transform, 
which allows one to transform functions on a vector space into functions on the 
dual space (see for instance |22|[5T] for excellent introductions to the topic). Given 
a Lagrangian L, we can define the associated Hamiltonian, as its Fenchel transform 
(or Fenchel- Leg endre transform): 

H : T*M — > M 

{x,p) I — > sup {{p,v)^- L{x,v)} 

where (•, denotes the canonical pairing between the tangent and cotangent 
space. 

If L is a Tonelli Lagrangian, one can easily prove that H is finite everywhere 
(as a consequence of the super linearity of L), C^, superlinear and strictly convex 
in each fiber (in the sense). Such a Hamiltonian is called Tonelli (or optical) 
Hamiltonian. 

Definition 2.3 (Tonelli Hamiltonian). A function H : T*M — > M is called a 
Tonelli (or optical) Hamiltonian if: 

i) H is of class ; 

ii) H is strictly convex in each fiber in the sense, i.e., the second partial 
vertical derivative d^H/dp^{x,p) is positive definite, as a quadratic form, 
for any {x,p) € T* M ; 

iii) H is superlinear in each fiber, i.e., 

y H{X,P) 

lim — iT-ji — = +00 . 

l|p||,^+oo \\p\\x 



Examples of Tonelli Hamiltonians. 

Let us see what are the Hamiltonians associated to the Tonelli Lagrangians that 
we have introduced in the previous examples. 

• Riemannian Hamiltonians. If L{x,v) — is the Riemannian La- 
grangian associated to a Riemannian metric g on M, the corresponding 
Hamiltonian will be 

H{x,p)^^\\p\\l 

where || • || represents - in this last expression - the induced norm on the 
cotangent space T*M. 

• Mechanical Hamiltonians. If L{x,v) = + U{x) is a mechanical 

Lagrangian, the associated Hamiltonian is: 

H{x,p)^^\\p\\l-U{x), 
that it is sometime referred to as mechanical energy. 
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• Mane's Hamiltonians. If X is a C*^ vector field on M, with k > 2, and 
Lx{x,v) = \\v — X(a;)||^ is the associated Mane Lagrangian, one can check 
that the corresponding Hamiltonian is given by: 

H{x,p) = \\\p\\l + {p,X{x)). 

Given a Hamiltionian one can consider the associated Hamiltonian flow on 
T*M. In local coordinates, this flow can be expressed in terms of the so-called 

Hamilton's equations: 

.2^ / ±it) = %{x{t),p{t)) 

^ ^ I P(t) = -|f(x(i),p(t)). 

We shall denote by Xii{x,p) := (^^{x,p), —^{x,p)^ the Hamiltonian vector 

field associated to H. This has a more intrinsic (geometric) deflnition in terms of 
the canonical symplectic structure U! on T*M. In fact, Xh is the unique vector 
field that satisfies 

Lo{XH{x,p),-)=d^H{-) V(x,p)eT*M. 

For this reason, it is sometime called symplectic gradient of H. It is easy to check 
from both definitions that - only in the autonomous case - the Hamiltonian is a 
prime integral of the motion, i.e., it is constant along the solutions of these equa- 
tions. 



Now, we would like to explain what is the relation between the Euler-Lagrange 
flow and the Hamiltonian one. It follows easily from the deflnition of Hamiltonian 
(and Fcnchel transform) that for each (x, v) € TM and {x,p) € T*M the following 
inequality holds: 

(3) (p,v).,<Lix,v) + H{x,p). 

This is called Fenchel inequality (or Fenchel-Legendre inequality) and plays a crucial 
role in the study of Lagrangian and Hamiltonian dynamics and in the variational 
methods that we are going to describe. In particular, equality holds if and only 
if p = dL/dv{x,v). One can therefore introduce the following diffeomorphism 
between TM and T*M, known as Legendre transform: 



(4) 



C : TM 

{x,v) 



T*M 



dL 

dv 



(x, v) 



Moreover the following relation with the Hamiltonian holds: 

'dL 



H o C{x,v) 



dv 



{x,v), 



L{x, v) . 



A crucial observation is that this diffeomorphism C represents a conjugation be- 
tween the two flows, namely the Euler-Lagrange flow on TM and the Hamiltonian 
flow on T*M; in other words, the following diagram commutes: 



TM 
c 

T*M- 



-TM 
c 

Y 

•T*M 



Remark 2.4. Since C and the Hamiltonian flow are both C^, then it follows 
from the commutative diagram above that the Euler-Lagrange flow is also C^. 
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Therefore one can equivalently study the Euler-Lagrange flow or the Haniilton- 
ian flow, obtaining in both cases information on the dynamics of the system. Each 
of these equivalent approaches will provide different tools and advantages, which 
may prove very useful to understand the dynamical properties of the system. For 
instance, the tangent space is the natural setting for the classical calculus of varia- 
tions and for Mather and Marie's approaches (sections |4] and |5| ; on the other hand, 
the cotangent space is equipped with a canonical symplectic structure, which allows 
one to use several symplectic topological tools, coming from the study of Lagrangian 
graphs, Hofer's theory, Floer Homology, etc ... Moreover, a particular fruitful ap- 
proach in T* M is the so-called Hamilton- Jacobi method (or Weak KAM theory), 
which is concerned with the study of solutions and subsolutions of Hamilton-Jacobi 
equations. In a certain sense, this approach represents the functional analytical 
counterpart of the above-mentioned variational approach (section |6| . In the fol- 
lowing sections we shall provide a complete description of these methods and their 
implications to the study of the dynamics of the system. 



3. A CARTOON EXAMPLE: PROPERTIES OF MEASURES AND ORBITS ON KAM 

TORI 

Before entering into the details of Mather's work, we would like to discuss some 
properties of orbits and invariant probability measures that are supported on KAM 
tori. This will provide us with a better understanding of the ideas behind Mather's 
theory and allow to see in what sense these action-minimizing sets - namely, what 
we shall call Mather, Aubry and Mane sets - represent a generalization of KAM 
tori. 

Let H ■.T*T'^ — ^ M be a ToneUi Hamiltonian and L : TT"* — s- M its associated 
Tonelli Lagrangian and let us denote by <i>^ and $^ the respective flows. Observe 
that one can identify T*T'^ and TT'^ with T'* x R'^. First of all, let us define what 
we mean by KAM torus. 

Definition 3.1 (KAM Torus). T C T'' x M'' is a (maximal) KAM torus with 
rotation vector p if: 

i) T C T'' X M'' is a Lagrangian graph, i.e., T = {{x, c -f du) : x e T''}, where 
c e M'* and u : T'' — > R; 

ii) T is invariant under the Hamiltonian flow <i>^ generated by H; 

iii) the Hamiltonian flow on T is conjugated to a uniform rotation on T*^; i.e., there 
exists a diffeomorphism : T'^ — > T such that ip~^ o o (p — i?^, \/t E R, where 
K'p : X ^ X -\- pt (mod. Z'^). In other words, the following diagram commutes: 



A /, 

— ^Jd 
K 

Remark 3.2. (i) First of all, let us remark that, up to some small technicalities 
in the proofs, most of the results that we shall discuss in this section, will continue 
to hold if we assume T to be only Lipschitz rather than . 

(ii) If p is rationally independent, i.e., p ■ k ^ for all fc S Z'' \ {0}, then each 
orbit is dense on it (i.e., the motion is said to be minimal). Therefore, it supports 
a unique invariant probability measure. Consider the case in which p admits some 
resonance, i.e., there exists fc € Z"* \ {0} such that p ■ k = Q. The set of resonances 
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of p forms a module over Z. Let r denote its rank. Then, T is foliated by an 
r-dimensional family of [d — r)-tori, on each of which the motion is minimal. 

{Hi) If p is rationally independent then a classical result by Michel Herman 
implies that this torus is automatically Lagrangian (see Proposition 3.2]). 

{iv) Since T is Lagrangian and invariant under the Hamiltonian flow, then the 
Hamiltonian H is constant on it, i.e., H(x, c + du) = Ec for some i?c G M (it follows 
from the definition of the Hamiltonian flow). In particular, m is a classical solution 
of Hamilton-Jacobi equation H{x, c + dv) = k. It is easy to check that, for a fixed c, 
all solutions have the same energy. In fact, let u and v be two solutions. Then, the 
function u — v will have at least a critical point xq and at xq the two differentials 
must coincide: dxgU — d^^v. This implies that H{xa, c + dx„u) = H{xq, c + dxgv). 
Moreover, Ec is the least possible fc G M such that there can exist subsolutions of 
the equation H{x, c + dv) — k, namely v G C^{T'^) satisfying H{x, c + dv) < k for 
all X £ T"^. The proof is essentially the same as above. In fact, since the function 
u — V has at least a critical point and at xq the two differentials coincide, then 
Ec = H{xo, c + dxgu) = H{xo, c + d^ov) < k. 



Let us start by studying the properties of invariant probability measures that are 
supported on T. Let p* be an ergodic invariant probability measure supported on 
T. It will be more convenient at this point to work in the Lagrangian setting. Let 
us consider the correspondent invariant probability measure for the Euler-Lagrange 
flow (p^, obtained using the Legendre transform: p = C*p*, where C* denotes the 
pull-back. We would like to point out some properties of this measure and see how 
T can be characterized using measures satisfying such properties. 

Properties: 

(1) First of all, observe that J vdp — p. To see this, let us consider the universal 
cover of T'*, I.e., and denote by: 

• r := {iq,c + dil{q)), q G R''} the lift of T to M^', where {j is a periodic 
extension of u; 

• $^ the suspension of the Hamiltonian flow $^ to M'* x M'*; 

• ip the lift of ip, i.e., (p : M."^ ^ T such that the following diagram 
commutes: 




where i?* : q ^ q + pt. Moreover, ip has the form ip{q) = {ipq{q),c + 
du{(pq{q))) and pq satisfies (pq{q + fc) = ^q{q) + k for each k E . 

Now, let (xo, cA-duixo)) be a point in the support of p* and consider the 
corresponding orbit Jxoit) T^^i^ {^Oi ^ + du{xo)), where n : T*T'' — > T"^ 
is the canonical projection. Denote by 0^(t) its lift to M'*. Then, using the 
ergodic theorem (remember that we are assuming that p* , and hence p, is 
ergodic), we have that for a generic point (xq, c + du{xQ)) in the support of 
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jj.* the following holds: 



vdi, = hm lim 



?i— >-+oo n Jq ri— !.+oo n 

= lim ^"(''^ = lim ^g(^^'(^o("))+"^) 

n— >-+oo ri n— i.+oo n 



= lim 



n n 
= P 

where [•] and {•} denote respectively the integer and fractional part of the 
vector (component by component). 

Remark 3.3. We shall say that /i has rotation vector p. See also Section 

SI 

(2) Let / : T"^ — ^ M be a function. Then, / df{x) ■ vdfi = 0. In fact, 
take (xq^vq) e supp/i and denote the corresponding orbit by {xt,Vt) = 
$f (zqjUo). Since p, is invariant, then tf>f^/i = p. and therefore: 

df{x)-vdy. = dt f df{x)-vd<^>^^fi = 

1 



— / dt df{xt) ■ vtdfj. 

^ Jo JTT'' 



1 



T 



dji / df{xt) ■ Vfdt = 

TT' Jo 

since / is bounded. A measure satisfying this condition is said to be closed 
(see also Addendum 4. A). Observe that in the above proof we have not 
used anything else than the invariance of /i. See also Proposition |4.7[ 

(3) Recall that Ec is the energy of T, i.e., H{x, c + du) = Ec. We want to show 
that this energy value is somehow related to the average value of L on the 
support of fi. Observe in fact that: 

L{x,v)diJ,— / \^L{x , v) — {c + du) ■ d/i + / {c + du)-vdii. 

Using the property just pointed out in (2) and observing that, because of the 
Fenchel-Legendre (in) equality ([3|, along the orbits {xt,Vt) in the support 
of /Lt we have {c + du{xt)) -vt — L{xt,vt) + H (x , c + du{xt)) = L{xt,vt) + E^ 
we can conclude that: 

/ L{x,v)dfi= = Ecdii+ c-vd^ = 



= —Ec + c- / V dp, — —Ep + c-p. 

JTT'' 

In particular, Jr^jd [L{x,v) — c • w] d/i = —Ec. Observe that this new La- 
grangian Lc{x,v) = L(x,v) — c ■ v is still Tonelli and it is immediate to 
check that it has the same Euler-Lagrange flow as L. 



We can now show this first result. 
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Proposition 3.4. If jl is another invariant probability measure of , then 
(5) / Lc{x,v)dfL> / Lc{x,v)d^. 

Therefore, ^ minimizes the average value of (or action of L^) among all invariant 
probability measures of (or $f since they are the same). 
Warning: in general, it does not minimize the action of L ! 

Proof. The proof is an easy application of Fenchel-Legendre inequality ([S]) . Ob- 
serve that in the support of jl, differently from what happens on the support of ^ 
(see property (3) above), this is not an equality, i.e., (c + du{x)) ■ v < L{x,v) + 
H{x, c + du{x)) = L{x, v) + Ec. Then: 

/ Lc{x,v)djl = I \L{x , v) — [c + du) ■ v\ dfi > 

> - / Ecdfi ^ -Ec = / Lc{x,v)dfi. 

□ 

Remark 3.5. (i) It follows from the above proposition that 



Er ~ ~ min 



< / Lc{x, v) dji : /i is a <I>^-invariant probability measure > 

I JTT"* J 



The minimizing action on the right-hand side is also denoted by a(c) (see the 
definition of Mather's a- function in Section [1]). 

(ii) A measure ^ that satisfies the inequality (|5| for all invariant probability 
measures jl, is called c-action minimizing measure (or Mather's measure with coho- 
mology class c); see Section |4j 



(iii) It is easy to see from the proof of Proposition 3.4 and Fenchel-Legendre 
inequality, that if supp /i is not contained in £~^(T), then the inequality in ^ is 
strict. 



(iii) In particular, using the previous remark and (ii) in Remark 3.2 we obtain 
that 

C^^(T) = (J{supp/i : ^ is a c-action minimizing measure}. 

The set on the right-hand side is often denoted by Aic and called Mather set of 
cohomology class c. It will be defined in Section |4] 



Let us now observe that although /i does not minimize the action of L among all 
invariant probability measures (we have pointed out in fact that it minimizes the 
action of a modified Lagrangian, with the same Euler Lagrange flow as L), then it 
does minimize it if we put some extra constraints. 

Proposition 3.6. If ji is another invariant probability measure of with rotation 
vector p (in the sense of property (1) above) , then 

(6) / L{x,v)dji> / L{x,v)dfi. 

Jj^Jd JTJd 
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Proof. The proof is the same as before, using Fenchel-Legendre inequahty (|3|, the 
fact that J V dp. = p and property (3) above. In fact: 

L{x^v)dji = / \Jj[xtv) — [c + du) ■ v\ dp + I {c + du)-vdp> 



> —Ec ~^ c ' V dp — 

= —Ec + c-p^ / L{x,v)dp. 

□ 

Remark 3.7. (i) It follows from the above proposition that 

—Ec+c-p = mm< / L{x,v)dp: /2 is a $^-inv. prob. meas. with rot. vector p > . 

Utt'' J 

The minimizing action on the right-hand side is also denoted by /3(p) (see the 
definition of Mather's /3-function in Section |4]) . 

(a) A measure p that satisfies the inequality ^ for all invariant probability 
measures p with rotation vector p, is called action minimizing measure (or Mather's 
measure) with rotation vector p; see Section |4] 

(Hi) It is easy to see from the proof of Proposition 3.6 and Fenchel-Legendre 
inequality, that if p has rotation vector p, but its support is not contained in 
£~^(T), then the inequality in ^ is strict. 

(iw) In particular, using the previous remark and (ii) in Remark 3.2 we obtain 
that 

C^^{T) = \^{supp p : /i is an action minimizing measure with rotation vector p}. 

The set on the right-hand side is often denoted by MP and called Mather set of 
homology class p. It will be defined in Section [4] 



Summarizing, if p is any invariant probability measure of <i>^ supported on 
C'^T), then: 

- p minimizes the action of L(x, v) — c ■ v amongst all invariant probability 
measures of 

- p minimizes the action of L{x,v) amongst all invariant probability mea- 
sures of with rotation vector p. 



Let us now shift our attention to orbits on KAM tori and see what are the 
properties that they enjoy. Let (a;o, c + d^gu) G T a point on the KAM torus and 
consider its orbit under the Hamiltonian fiow, i.e., ^{t) — tt^^ {xo, c + dxou), where 
as usual tt : T*T'^ — > T"* denotes the canonical projection along the fiber. Let us 
fix any times a < b and consider the corresponding Lagrangian action of this curve. 
Using Fenchel-Legendre (in) equality we get: 

/ L(7(i),7(t))dt = / i{c + d^(t)u)i{t)-H{i{t),c + d^(^t)u))dt^ 

b 

C7(t) dt + u{j{b)) - -u(7(a)) - Ec{b - a) . 




LECTURE NOTES ON MATHER'S THEORY FOR LAGRANGIAN SYSTEMS 



13 



Therefore, considering as above the action of the modified Lagrangian Lc{x, v), we 
get: 

(7) /' L,(7(t), W)) dt = ^i(7(6)) - u{j{a)) ^ E,{b ^ a) . 

J a 

Let us now take any other absolutely continuous curve ^ : [a, b] — > T'^ with the 
same endpoints as 7, i.e., ^(a) = 7(a) and ^(&) — 7(6). Proceeding as before and 
using Fenchel-Legendre InequaHty, we obtain: 

L{^{t),i{t))dt > J (^{c + d^(^t)u)iit)^H{^it),c + d^(^t)u))dt = 

b 

ci{t) dt + u{£_{b)) ~ w(C(a)) - Ec{b - a) . 

Hence, using ^ and the fact that ^(a) = 7(a) and ^(6) — 7(6), we can conclude 
that: 

(8) f\,{j{t),j{t))dt < f L,m,mdt. 

Therefore for any times a < 6, 7 is the curve that minimizes the action of over 
all absolutely continuous curves ^ : [a, 6] — > T'^ with ^(a) — 7(a) and ^(6) = 7(fc)- 
Actually something more is true. Let us consider a curve with the same endpoints, 
but a different time-length, i.e., ^ : [a', 6'] — > T*^ with o! < b' and such that 
£,{a') = 7(a) and £,{b') = ^{b). Proceeding as above, one obtains 

Lc{mA{t))dt > u{ab'))-u{aa'))-E,{b' ~a') 



and consequently 

' (L,(7(i),7(t))+i?e)rft < £ (LMt),m) + E,)dt. 

Hence, for any times a < b, ^ minimizes the action of L^ + E^ amongst all absolutely 
continuous curves ^ that connect 7(a) to ^(6) — 7(6) in any given time (adding a 
constant does not change the Euler-Lagrange flow). 
We have just proved the following proposition. 

Proposition 3.8. For any given a < b, the projection 7 of any orbit on T mini- 
mizes the action of amongst all absolutely continuous curves that connect 7(a) 
to 7(6) in time b — a. Furthermore, 7 minimizes the action of Lc + Ec amongst all 
absolutely continuous curves that connect 7(a) to 7(6) in any given time length. 

Remark 3.9. (z) A curve 7 : M — > T'^ such that for any a < b, j\[a, b] minimizes 
the action of Lc amongst all absolutely continuous curves that connect 7(a) to 7(6) 
in time & — a, is called a c-global minimizer of L. 

(ii) A curve 7 : M — > T'^ such that for any a < b, 7|[a, b] minimizes the action 
of Lc amongst all absolutely continuous curves that connect 7(a) to 7(6) without 
any restriction on the time length, is called a c-time free minimizer of L. 



(Hi) Proposition 3.8 can be restated by saying that the projection of each orbit 
on T is a c-global minimizer of L and a c-time free minimizer oi L + Ec. Moreover, 
it follows easily from the proof and Fenchel-Legendre inequality, that if the curve 
f does not lie on T, then the inequality in ([8| is strict. 
In particular, we obtain that: 

C^^{T) = [^{{jit), jit)) : 7 is a c-global minimizer of L and t £ M}. 
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The set on the right-hand side is often denoted by Mc and called Mane set of co- 
homology class c. It will be defined in Section [5) 

Actually, these curves on T are more than c-global minimizers. As we shall see, 
they satisfy a more restrictive condition. In order to introduce it, let us introduce 
what is called the Marie potential. Let Xi,X2 E T"^ and let us denote by h"^ {xi, X2) 
the mininiinial action of Lc along curves that connect xi to X2 in time T. We want 
to consider the infimum of these quantities for all positive times. Of course, without 
any "correction" this infimum might be —00. Hence, let us consider the action of 
Lc + k for some A; G M and define: 

(9) (l)c.k{xi,X2) ■■= |,nf [h^{xi,X2) + kT) . 

We want to see for which values of k this quantity is well-defined, i.e., it is > —00. 
Let 7 : [0,T] — > T"^' be any absolutely continuous curve such that 7(0) — xi and 
7(T) = X2. Then, using Fenchel Legendre inequality: 

/ Lc{i[t),^{t))dt + kT > [ {du{j{t)-^{t)-H{-/{t),c + d^^t)u)) dt + kT = 
Jo Jo 

= ui^iT))~ui^iO)) + ik-Ec)T = 

(10) = u{x2) - u{xi) + {k - Ec)T . 

Taking the infimum over all curves connecting xi to X2, we obtain: 

0c,i;(a;i, a;2) > u{x2) - u{xi) + (fc - Ec)T. 

Therefore, if A; > Ec, then (l)c.k{xi,X2) > —00 for all xi,X2 £ T'^. On the other 
hand, it is quite easy to show that for k < Ec, (j>c.k{xi, X2) — ~oo for all xi,X2 G T''. 
Let us observe the following: 

• If fc < Ec, then (l)c.k{x,x) — —00 for all x G T'^. In fact, we know that 
the orbit j{t) = TT^f {x, c + du{x)) is recurrent, i.e., there exist T„ — > 
-|-oo such that 6n ■= \\"f{Tn) — x\\ — >■ as n — >■ 00. Consider the curve 
^ : [0, Tn + Sn] -> T'^ obtained by joining the curve 7 to the unit speed 
geodesic connecting 7(T'„) to x. Then, proceeding as before and using 
Fenchel-Legendre inequality and the continuity of u, we obtain: 

(l)c,k{x,x) < / Lc{i,i)dt+ Lc{£.,i)dt + k{Tn + 5n)< 

Jo JTr, 

< u(7(T„)) - u{x) + ASn + {k- Ec)Tn + kSn -00, 

where A := maxy^n^i \Lc{x,v)\. 

• It is also easy to check that for any fc, 0c, fc satisfies a sort of triangular 
inequality: 

<Pc,k{x,y) < (j)c,k{x,z) + (f>c,k{z,y) y x,y,z e T'^. 

For the proof of this, observe that any absolutely continuous curve connect- 
ing x to z and any absolutely continuous curve connecting z to y, determine 
a curve from x to y. Passing to the infimum, one gets the result. 

Our claim follows easily from these two observations. In fact, let k < Ec and 
Xi,X2e T'^. Then: 

0c,fc(a;i,a;2) < <l)c,k{xi,xi) + <l)c,k{^i,X2) = -00. 

Summarizing, we have proved the following proposition. 
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Proposition 3.10. 

Ec = inf{fc e M : 0c,fe(a;, y) > -oo for all x,y e T'^} = 

= supjfc e M : (j)c^k{x,y) = — oo for all x,y £ T'^} = 

= supjfc e M : (pckix, x) — — oo for all x G T''} ~ 

= supjfc e M : (j)c,k{x, x) — — oo for some x £ T''} . 

Observe that the second and fourth equality are simply a consequence of the trian- 
gular inequality. 

Let us go back to our c-global minimizing curves. We have seen (Proposition 



3.8 1 that if 7 is the projection of an orbit on T, then it is a c-global minimizer of 
L and furthermore it is a c- time free minimizer of L -|- E(.. The last property can 
be rewritten in terms of the Mane potential: 

b 

{Lc{j{t),^{t)) + E^) = 0c,ij,(7(a),7(&)) for any a < b. 

Therefore these curves seems to be related to the Mane potential corresponding 
to k = Ec (the least value for which it is defined). Observe that in this case, we 



obtain from ( 10 I that 0c. {x, y) > u{y) — u{x) for all x, y € T'' and consequently: 
(11) (f>c,EAy^^) > ""(2;) - u{y) = -{u{y) - u{x)) > -0c,B, (a;, ?/) , 

which provides a lower bound on the action needed to "go back" from y to x. In 
particular, if ^ : [a, b] T'' is an absolutely continuous curve, then: 

(ic(^,o + i?c) dt > c^c^EAaa),m) > -'i^c,EAm,aa)) . 

Question: do there exist curves for which these inequalities are equalities. Ob- 
serve, that if such a curve exists, then it must necessarily be a c-minimizer . We 
shall show that the answer is affirmative and characterize such curves in our case. 

Proposition 3.11. Let 7 be the projection of an orbit on T. Then, for each a < b 
we have: 

cb 

(Lc(7, 7) + E,) dt = 0c,£^ (7(a), 7(6)) = -</'c,£. (7(&), 7(«)) • 



Remark 3.12. (z) A curve 7 : M — > satisfying the conditions in Proposition 
|3.11| is called c-regular global minimizer or c-static curve of L. Observe that the 
adjective regular (coined by John Mather) has no relation to the smoothness of the 
curve, since this curve will be as smooth as all other solutions of the Euler-Lagrange 
flow (depending on the regularity of the Lagrangian) . 

(ii) Since a c-regular global minimizer is a c-global minimizer (see the comment 



above), it follows from (Hi) in Remark 3.9 that these are all and only the c-regular 
global minimizers of L . Therefore: 

C^^{T) = [J{(7(i)i 7(0) ■ 7 is a c- regular global minimizer of L and t e M}. 

The set on the right-hand side is often denoted by Ac and called Aubry set of co- 
homology class c. It will be defined in Section [5j 



Proof. [Proposition 3.11 Let ^{t) := tt^^ {x,c + du{x)) and consider a < b. We 
already know from Proposition |3.8| that 

rb 

{Lc{j,j)+Ec)dt = (t>c,EAl{a):j{b)) ■ 
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Since the orbit is recurrent, there exist r„ — > +00 such that (5„ := ||7(6 + T„) — 
7(a) II — > 0. Consider the curve ^ : [b,b + r„ + Sn] T'^ obtained by joining the 
curve 7|[6, b + T„] to the unit speed geodesic connecting 7(6 + T„) to 7(a). Then, 
using Fenchel-Legendre inequahty and the continuity of u, we obtain: 



Lc{l,i)dt- 



b+T„+5„ 



L,{^,i)dt + E,{T,, + S^) < 



< u{j{b + r„)) - u{j{b)) + {A + E,)5^ u(7(a)) - ^(7(6)), 



where A := niax||j,j[^x |-^c(a;, ''^)|- Therefore, using (10), we obtain: 

0c,i;.(7W,7(a)) < ^(7(0)) - ^(7(6)) = -(^(7(6)) - ^(7(0))) 
= ~(l3c,EAl(.o),i{b)) 



that, together with (111, allows us to deduce that (7(6), 7(a)) = —(pcESli^) ^li^)) 



and conclude the proof. 



□ 



4. Action-minimizing measures: Mather sets 

In this section, inspired by what happens for invariant measures and orbits on 
KAM tori, we would like to attempt a similar approach for general Tonelli La- 
grangians on compact manifolds, and prove the existence of some analogous com- 
pact invariant subsets for the Euler-Langrange (or Hamiltonian) flow. In many 
senses, these sets will resemble and generalize KAM tori, even when these do not 
exist or it does not make sense to speak of them. 

Let us start by studying invariant probability measures of the system and their 
action-minimizing properties. Then, we shall use them to define a first family of 



invariant sets: the Mather sets (see Remark |3.5| {iii) and Remark 3.7 {in)). 
Let ^Xfl{L) be the space of probability measures /i on TM that are invariant under 
the Euler-Lagrange flow of L and such that Jr^j^,j £ rf/i < 00 (finite action) . It is 
easy to see in the case of an autonomous Tonelli Lagrangian, that this set is non- 
empty. In fact, recall that because of the conservation of the energy E{x,v) := 
H o C{x, v) — (|^(x, v), ^ — L{x, v) along the motions, each energy level of E is 
compact (it follows from the superlinearity condition) and invariant under It 
is a well-known result by Kryloff and Bogoliouboff |3JL| that a flow on a compact 
metric space has at least an invariant probability measure. 

Proposition 4.1. Each non-empty energy level £{E) := {E(x,v) — E} contains 
at least one invariant probability measure of . 

Proof. Let {xo,vo) G £{E) and consider the curve 7(t) := 7r$f (xq, wq), where 
TT : TM — > M denotes the canonical projection. For each T > 0, we can consider 
the probability measure fj,T uniformly distributed on the piece of curve {'j(t),'j{t)) 
for t e [0,r], i.e., 



r 

T 



fdfiT^}f;l f{i{t),j{t))dt \ffeC{£{E)). 



The family {/kt}t is precompact in the weak* topology; in fact the set of proba- 
bility measures on £{E) is contained in the closed unit ball in the space of signed 
Borel measures of £{E), which is weak* compact by Banach-Alaouglu theorem. 
Therefore, I can extract a converging subsequence {^J■Tn}n, such that ^j,t„ — > in 
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the weak* topology as r„ — > oo. We want to prove that is invariant, i.e., for each 
s e K we have ^'f'^/i — jJ.. Let / be any continous function on £{E). Then : 



fd^l 



< 



(12) 



From the weak* convergence fiT^ 

J fd<i>^,flT„ - 

and 



/i, we have that 



fd^ 



as T„ 



Moreover, using the definition of ^t„ '■ 



as Tn 



T„+s 



T„+s 



< 



1 
1 

-— max f 
T„ £{E) '-^ ' 



/(7(i),7(i))rf^ 



f{j{t),i{t))dt- 



f{j{t),j{t))dt 
fij{t),^it))dt 



< 



as T„ +O0. 



Therefore, it follows from (12) that for any / G S^E) 

fd^i 



fd<^tf^ 



0. 



Consequently, ^f'^/i = /i for any s G M, i.e., fi is $^-invariant. 
To each jj, e 9Jt(L), we may associate its average action 



□ 



L dfj, . 



TM 



Clearly, the measures constructed in Proposition |4 . 1 1 have finite action. 

Remark 4.2. One can show the existence of invariant probability measures with 
finite action, also in the case of non- autonomous time-periodic Lagrangians. As 
it was originally done by Mather in |32], one can apply KrylofF and Bogoliouboff's 
result to a one-point compactification of TM and consider the extended Lagrangian 
system that leaves the point at infinity fixed. The main step consists in showing 
that the measure provided by this construction has no atomic part supported at oo 
(which is a fixed point for the extended system). 



Note: We shall hereafter assume that Dyi{L) is endowed with the vague topol- 
ogy, i.e., the weak* topology induced by the space C° of continuous functions 
/ : TM — > M having at most linear growth: 

1/(^,^)1 , , 
^^P 1 < ■ 

{x,v)eTM ^ + \\v\\ 

It is not difficult to check that 9Jt(L) C (C^)* . Moreover it is a classical result 
that this space, with such a topology, is metrizable. A metric, for instance, can be 
defined as follows. Let {/«}„ be a sequence of functions with compact support in 
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C° which is dense in the topology of uniform convergence on compact sets of TM. 
Define a metric on 9Jt(L) by: 



(^(Mi,M2) 



\v\d^ii - / \v\d^: 



4^2"|i/„|!, 



See also Addendum 4. A at the end of this section for more details on this topology. 

Proposition 4.3. '■ — > M is lower semicontinuous with the vague topol- 
ogy on 9Jt(L). 

Proof. Let Al,k{p) ■= J min{L, K} dfi. for iiT G M. Then. Al,k is clearly contin- 
uous, actually Lipschitz with constant K. In fact: 

\AlMp) - AL,K{y)\ < Kd{^i,v). 

Moreover, since Al,k t 'as K oo, it follows that Al is lower semicontinuous. 

□ 

Remark 4.4. In general, this functional might not be necessarily continuous. 

This Proposition has an immediate, but important, consequence. 
Corollary 4.5. There exists /i G 9Jl(L), which minimizes Aj^ over 97t(i). 
We shall call a measure /i G 9H(L), such that A^di) — mingjij^) A^, an action- 



minimizing measure of L (compare with Remark 3.5 (ii)) 



Actually, one can find many other "interesting" measures, besides those found 



by minimizing L. We shall see later (see Remark 4.26), that in fact these measures 
minimizing the action of L, correspond to special measures with "trivial" homology 
(or rotation vector). On the other hand, as we have already pointed out in Proposi- 
tion 3.4 (and the following Warning), in order to get information on a specific KAM 
torus and characterize it via the invariant probability measures supported on it, one 
needs necessarily to modify the Lagrangian. Think for instance of an integrable sys- 
tem, for which we have a whole family of KAM tori. It would be unreasonable to 
expect to obtain ALL of them, just by minimizing a single Lagrangian action. One 
needs somehow to introduce some sort of "weight", which, without modifying the 
dynamics of the system (i.e., the Euler Lagrange flow), allows one to magnify cer- 
tain motions rather than others. What we found out in Proposition |3.4| was that 
this can be easily achieved by subtracting to our Lagrangian a linear function c- v, 
where c represented the cohomology class of the invariant Lagrangian torus we were 
interested in, or, in other words, the cohomology class of its graph (that is a closed 
1-form) in T*T'^. 

A similar idea can be implemented for a general Tonelli Lagrangian. Observe, 
in fact, that if 77 is a 1-form on M, we can interpret it as a function on the tangent 
space (linear on each flber) 

fi : TM — > M 

{x,v) I — > {■q{x),v)^ 

and consider a new Tonelli Lagrangian i,, := L — fj. The associated Hamiltonian 
will be given by Hrj{x,p) = H{x, rj{x) +p) (it is sufficient to write down the Fenchel- 
Legendre transform of L) . 

Lemma 4.6. // 77 is closed, then L and L^i have the same Euler- Lagrange flow on 
TM. 
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Proof. Observe that, since 77 is closed, the variational equations S[J Ldt\ — and 
6[J{L — fj) dt\ = have the same extremals for the fixed end-point problem and 
consequently L and have the same Euler-Lagrange flows. 

One can also check this directly, writing down the Euler-Lagrange equations asso- 
ciated to L and and observe that, since is closed (i.e., drj = 0), then 

|(|;^(7,7))=|(^(7)) = ^(r)(7,7)). 

Let us show in fact that they are equal component by component. If we denote by 
r]j and 7^ the j-th components of 77 and 7, then the ith component of the left-hand 
side of the above equation becomes: 

d „ 

J=l 

and on the other side: 

Since 77 is closed, then ^ — for each i and j. Therefore, the two expressions 
are the same. Therefore, the term coming from 77 does not give any contribution to 
the equations. □ 

Although the extremals of these two variational problems are the same, this is 
not generally true for the orbits "minimizing the action" (we shall give a precise 
definition of "minimizers" later in section [5| . We have already given evidence of 
this in Proposition |3.4[ What one can say is that these action-minimizing objects 
stay the same when we change the Lagrangian by an exact 1-form. 

Proposition 4.7. // /i G ^(L) and rj = df is an exact 1-form, then J dfdfi = 0. 

The proof is essentially the same as in Section [s] (Property 2), so we omit it. See also 
[421 Lemma on page 176] . Let us point out that a measure (not necessarily invariant) 
that satisfies this condition, is called closed measure (see also the Addendum at the 
end of this section) . 

Thus, for a fixed L, the minimizing measures will depend only on the de Rham 
cohomology class c = [?/] e H^(M;]R). Therefore, instead of studying the action 
minimizing properties of a single Lagrangian, one can consider a family of such 
"modified" Lagrangians, parameterized over H^{M;M.). 

Hereafter, for any given c G H^{M;M.), we shall denote by rjc a closed 1-form with 
that cohomology class. 



Definition 4.8. Let rjc be a closed 1-form of cohomology class c. Then, if ^ € 9Jl(L) 
minimizes A^^ over dyi{L), we shall say that ^ is a c-action minimizing measure 
(or c-minimal measure, or Mather's measure with cohomology c). 

Remark 4.9. Observe that the cohomology class of an action-minimizing invariant 
probability measure, is not something intrinsic in the measure itself nor in the 
dynamics, but it depends on the specific choice of the Lagrangian L. Changing the 
Lagrangian L 1 — > L — 77 by a closed 1-form 77, we shall change all the cohomology 
classes of its action minimizing measures by —[77] £ H^(Af;]R). Compare also with 



Remark 4.14 (ii) 



One can consider the function on H^(Af;M), which associates to each cohomol- 
ogy class c, minus the value of the corresponding minimal action of the modified 
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Lagrangian Ljj^ (the minus sign is introduced for a convention that might probably 
become clearer later on): 

a:R^{M;R) — > R 
(13) CI — > - min (/i). 

This function a is well-defined (it does not depend on the choice of the represen- 
tatives of the cohomology classes) and it is easy to see that it is convex. This is 
generally known as Mather's a-function. As it happened for KAM tori (see Re- 
mark 3.5 1, we shall see in section [s] that the value a{c) is related to the energy 



level containing such c-action minimizing measures (they coincide). See also |13j . 
Therefore, if we have an integrable Tonelli Hamiltonian H(x,p) — h{p) it is easy 
to deduce that a(c) = h{c). For this and several other reasons that we shall see 
later on, this function is sometime called effective Hamiltonian. It is interesting 
to remark that the value of this a - function coincides with what is called Mane's 
critical value, which will be introduced later in sections |5] and [6] 

We shall denote by DJlc{L) the subset of c-action minimizing measures: 
Mc := VJlc{L) = e m{L) : ^l(^) < +^ and Al^^ (/i) = -a(c)}. 



We can now define a first important family of invariant sets (see Remark 3.5 
(Hi)): the Mather sets. 

Definition 4.10. For a cohomology class c E H^(Af;M), we define the Mather set 
of cohomology class c as: 

(14) M^:= y suppAiCTM. 



The projection on the base manifold M.c = \J^<^j — called projected Mather 

set (with cohomology class c). 

Remark 4.11. (i) This set is clearly non-empty and invariant. Moreover, it is also 
closed. Observe that usually it is defined as the closure of the set on the right-hand 
side. This is indeed the original definition given by Mather in [42|. However, it is 
not difficult to check that this set is already closed. In fact, since the space of prob- 
ability measures on TM is a separable metric space, one can take a countable dense 
set {iJ.n}^=i of Mather's measures and consider the new measure fj, = X^^i ^l^n- 
This is still an invariant probability measure and it is c-action minimizing (it follows 
from the convexity of a), hence supp/z C A^^- But, from the definition of fi one can 
clearly deduce that supp fi = U^eroi^supp /x 3 Mc- This implies that supp p = Mc- 

Therefore, as the support of a single action minimizing measure, A^c is closed (the 
support of a measure, by definition, is closed). Moreover, this remark points out 
that there always exists a Mather's measure pc of full support, i.e., supp — M.c- 



a) As we have pointed out in Remark 3.5 if there is a KAM torus T of cohomol 



ogy class c, then A4c = £^^(T). In particular, the same proof continues to hold if 
we replace T with any invariant Lagrangian graph A of cohomology class c, which 
supports an invariant measure /i of full support (i.e., supp/x = A). 

In |42| Mather proved the celebrated graph theorem: 



Theorem 4.12 (Mather's graph theorem). Let Aic be defined as in {14-). 
The set Mc is compact, invariant under the Euler- Lagrange flow and ■n\Mc is an 
injective mapping of A4c into M, and its inverse tt^^ : Mc — > Mc is Lipschitz. 
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We shall not prove this theorem here, but it will be deduced from a more general 
result in SectionjS] namely, the graph property of the Aubry set. Moreover, similarly 



to what we have seen for KAM tori (see Remark 3.5 1, in the autonomous case this 
set is contained in a well-defined energy level, which can be characterized in terms 
of the minimal action a{c). 

Theorem 4.13 (Carneiro, ^ISj). The Mather set J\4c is contained in the energy 
level {H o C{x, v) = a{c)}. 

Also this result will be deduced from a similar result for the Aubry and Mane sets. 
See Proposition |5.23| in Section [Sj 

Now, we would like to shift our attention to a related problem. As we have 
seen in section |3] instead of considering different minimizing problems over 9Jt(L), 
obtained by modifying the Lagrangian L, one can alternatively try to minimize the 
Lagrangian L putting some ^^constraints", such as, for instance, fixing the rotation 
vector oi the measures. In order to generalize this to Tonelli Lagrangians on compact 
manifolds, we first need to define what we mean by rotation vector of an invariant 
measure. 

Let /i e 97l(i). Thanks to the superlinearity of L, the integral jr^j^fjdfjL is well 
defined and finite for any closed 1-form rj on M. Moreover, we have proved in 



Proposition 4.7 that if rj is exact, then such an integral is zero, i.e., /jj^j f]dn = 0. 



Therefore, one can define a linear functional: 

H\M;E) — > M 

ffd^i, 



ITM 

where rj is any closed 1-form on M with cohomology class c. By duality, there exists 
p{^j,) e Hi(Af;M) such that 

fidfi^ (c^pip)) VceHi(M;M) 

TM 

(the bracket on the right-hand side denotes the canonical pairing between coho- 
mology and homology). We call p{p) the rotation vector of p (compare with the 
definition given in Section |3] Property (1)). This rotation vector is the same as the 
Schwartzman's asymptotic cycle of p (see [52] for more details). 

Remark 4.14. (i) It is possible to provide a more "geometrical" interpretation of 
this. Suppose for the moment that p is ergodic. Then, it is known that a generic 
orbit 7(t) :— 7r<i>f (x, v), where n : TM — > M denotes the canonical projection, will 
return infinitely many often close (as close as we like) to its initial point 7(0) — x. 
We can therefore consider a sequence of times T!„ — > -l-oo such that d{j{Tn), x) 
as n — !■ +00, and consider the closed loops (t„ obtained by "closing" 7|[0,T„] with 
the shortest geodesic connecting j{Tn) to x. Denoting by [fT„] the homology class of 
this loop, one can verify t52j that lim„_>.oo = p{p), independently of the chosen 
sequence {T„}„. In other words, in the case of ergodic measures, the rotation vector 
tells us how on average a generic orbit winds around TM. If p is not ergodic, p{p) 
loses this neat geometric meaning, yet it may be interpreted as the average of the 
rotation vectors of its different ergodic components. 

(ii) It is clear from the discussion above that the rotation vector of an invariant 
measure depends only on the dynamics of the system {i. e., the Euler-Lagrange fiow) 
and not on the chosen Lagrangian. Therefore, it does not change when we modify 
our Lagrangian adding a closed one form. 
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A natural question is whether or not for a given Tonelli Lagrangian L, there exist 
invariant probabiHty measures for any given rotation vector. The answer turns out 
to be affirmative. 

In fact, using that the action functional : 9Jt(i) — > M is lower semicontinu- 
ous, one can prove the following 

Proposition 4.15. (i) The map p : 9Jl(L) — > Hi(M;M) is continuous. 

(ii) The map p : 2H(L) — > Hi(il/;M) is ajfine, i.e., for any /x, j/ g 9Jt(L) and 
a, 6 > with a + b = I, p{ap, + bv) = ap{p) + bp{v). 

(iii) For every h g Hi(M;M) there exists p G 2H(L) with Al{p) < oo and p(j.i) ~ h. 
In other words, the map p is surjective. 

Proof, (i) Let us fix a basis hi,...,hb in Hi(Af;M). where b is the first Betti 
number of M, i.e., b = dimHi(M;IR). 11 pLn ^ p and rjc is any closed one-form on 
M of cohomolgy class c, then 

(c, p{pn)) = y" • i^dpn j rjc ■ vdp = (c, p{p)), 

that is equivalent to say that: 

(c,p(/i„)-p(M)> "^°°0 VceR' -H\M;R). 

Therefore, p{pn) — — ^0 as n — )• +oo. 

(ii) The fact that the map p is affine, is a trivial consequence of the definition of 
rotation vector. 

(iii) Let h £ Hi(Af ; Z) be an integer homology class and choose •jh '■ [0, 1] — > M 
a closed loop with homology h. Let us consider the loop space: 

V,fi :— : [0, 1] — > M, abs. cont. loop with the same free homotopy class as jh}. 

One can prove [35_ that the Lagrangian action functional Al has a minimum on 
this space, which is a periodic orbit of the Euler-Lagrange flow, with period 1 (it is 
essentially Tonelli's theorem). Let us consider this periodic orbit 7 : [0,1] — > M 
and define an invariant probability measure p^ evenly distributed along this periodic 
orbit: ^ 

fdp,:^ [ f{j{t),j{t))dt V/eCO(TM). 



Jo 



It is easy to verify that such a measure is invariant, i.e., p^ = pj and, using 
the definition of rotation vector and Remark 4.14 that p{p^) — h. Since the map 



p is afline and D)l{L) is convex, it follows that p{D}l{L)) is convex. It follows from 
what discussed above, that this set must contain the convex hull of Hi(Af;Z) and 
therefore p{M{L)) = Hi(Af; E). □ 

As already pointed out in Section [3] amongst all probability measures with a 
prescribed rotation vector, a peculiar role - from a dynamical systems point of view 
- will be played by those minimizing the average action. Following Mather, let us 
consider the minimal value of the average action A over the probability measures 
with rotation vector h. Observe that this minimum is actually achieved because of 
the lower semicontinuity of A^ and the compactness of p~^{h) {p is continuous and 
L superlinear) . Let us define 

/3:Hi(Af;M) — > M 
(15) h I — > min Al{p) . 

This function /? is what is generally known as Mather's (3 -function and it is imme- 
diate to check that it is convex. As we have noticed in Remark 13.71 if there is a 
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KAM torus of cohomology class c and rotation vector p, then f3{p) = —Ec + c - p. 
Therefore, if we have an integrable Tonelli Hamiltonian H{x,p) = h{p) and the 
associated Lagrangian L{x,v) = i(v), it is easy to deduce that i3{h) — i{h). For 
this and several other reasons that we shall see later on, this function is sometime 
called effective Lagrangian. Moreover, this function is also related to the notion of 
stable norm for a metric d (see for instance [36|). 



We can now define what we mean by action minimizing measure with a given 
rotation vector (compare with Remark |3.7[m)). 



Definition 4.16. A measure fi e 9H(L) realizing the minimum in (15), i.e., such 
that Al{p,) = P{p{p)), is called an action minimizing (or minimal or Mather's) 
measure with rotation vector p{fi). 

Remark 4.17. We shall see in Section |5] that, differently from what happens 
with invariant probability measures, it will not be always possible to find action- 
minimizing orbits for any given rotation vector (not even define a rotation vector 
for each action minimizing orbit). This is one of the main difference with the twist 
map case. In higher dimensions, in fact, an example due to Hedlund [28] provides 
the existence of a Riemannian metric on a three-dimensional torus, for which min- 
imal geodesies exist only in three directions. 



We shall denote by dJl^{L) the subset of action minimizing measures with rota- 
tion vector h: 

m'' m''{L) = {/i e m{L) ■. Al{^i) < +00, p{n) = k and Al{p) = f3{h)}. 

This allows us to define another important familty of invariant sets (see also 
Remark |3.7| {Hi)). 

Definition 4.18. For a homology class (or rotation vector) h G Hi(M;IR), we 
define the Mather set corresponding to a rotation vector h as 

(16) M'' := U supp/iCTM, 

and the projected one as M.^ = tt ^A^''^ C M. 



Remark 4.19. (i) Similarly to what we have pointed out in Remark 4.11 this set is 
also non-empty and invariant. Moreover, it is also closed. Also in this case, it is not 
necessary to consider the closure of this set - as it is usually done in the literature- 
since it is already closed. Just take a countable dense set of Mather's 

measures with rotation vector h and consider the new measure jj, = X^^i ^t^n- 
This is still an invariant probability measure and its rotation vector is h. Moreover, 
it follows from the convexity of /3 that this measure is action-minimizing among 
all measures with rotation vector h. Hence, supp/i C M.^ . Clearly supp/i = 
U/iGOT'' supp/z 3 M.^ . This implies that supp /i = A^'\ Therefore, M.^ is closed. 
Moreover, this shows that there always exists a Mather's measure /i'' of full sup- 
port, i.e., supp^'' —M'^. 



(a) As we have pointed out in Remark 3.7 if there is a KAM torus T of rotation 



vector h, then Ai^ = C~^{T). In particular, the same proof continues to hold if 
we replace T with any invariant Lagrangian graph A, which supports an invariant 
measure p, of rotation vector p and of full support [i.e., supp/i = A). 



Also for the Mather set corresponding to a rotation vector, we can prove a result 
similar to Theorem 14.121 
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Theorem 4.20. Let he defined as in llm. M.^ is compact, invariant under 
the Euler- Lagrange flow and tt\A4''' is an injective mapping of into M and its 
inverse tt^^ : — > is Lipschitz. 

Remark 4.21. Although the g raph property for M.^ is not proved in [3^, it is 

using the fact that A^'' can be seen as the 



4.12 



easy to deduce it from Theorem 
support of a single action-minimizing measure (Remark 4.191 and that this set is 
included in some M.c; for some suitable c G H^(A/;M) (Proposition 4.251. 



The above discussion leads to two equivalent formulations for the minimality of 
a measure /i: 

• there exists a homology class h e Hi(Af;]R), namely its rotation vector 
yo(/i), such that minimizes amongst all measures in 9Jt(L) with rotation 
vector h] i.e., Al(ij) — [i{h). 

• There exists a cohomology class c e H^(M; M), such that ji minimizes A^^^ 
amongst all probability measures in 9Jt(L); i.e., Al^^ {^) = —a{c). 

What is the relation between two these different approaches? Are they equivalent, 

U/ieHi(M;R) ^ ^ UceHi(M:R) ? 

In order to comprehend the relation between these two families of action-minimizing 
measures, we need to understand better the properties of these functions 

a:ll\M;R) — >R and /3:Hi(M;E) — >R 

that we have introduced above. Let us start with the following trivial remark. 

Remark 4.22. As we have previously pointed out, if we have an integrable Tonelli 
Hamiltonian H(x,p) = h{p) and the associated Lagrangian L{x,v) = i{v), then 
a(c) = h{c) and (3{h) = £{h). In this case, the cotangent space T*T'' is foliated 
by invariant tori 7^* :— T'^ x {c} and the tangent space TT'^ by invariant tori 
:= T'^ X {h}. In particular, we proved that 

where h and c are such that h = Wh{c) = Va(c) and c = Vl{h) ~ V jSih). 

We would like to prove that such a relation that links Mather sets of a certain 
cohomology class to Mather sets with a given rotation vector, goes beyond the 
specificity of this situation. Of course, one main difficulty is that in general the 

effective Hamiltonian a and the effective Lagrangian /3, although being convex and 



superlinear (see Proposition 4.23), are not necessarily differentiable. 
Before stating and proving the main relation between these two functions, let us 
recall some definitions and results from classical convex analysis (see [5j). Given 
a convex function : V — > R U {+00} on a finite dimensional vector space V , one 
can consider a dual (or conjugate) function defined on the dual space V* , via the 
so-called Fenchel transform: (fl* (p) '■= snp^f^y (p ■ v — (p{v)Y 



Proposition 4.23. a and j3 are convex conjugate, i.e., a* ^ j3 and j3* — a. In 

particular, it follows that a and j3 have superlinear growth. 
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Proof. First of all, recall that (Hi(A/;M))* ~ Hi(M;M) and (H1(A/;M))'' 
Hi(M;K). Let us compute /?*: 

/3*(c) = max ((c, M - /3(/i)) = 

helii{M-M) 

= - min (/3(h) - (c.h)) ^ 

/ieHi(Af;R) 

= — min ( min AL(u) — {c,h) 
heiii(M-X) Xfi.emf'iL) 

= - min min (Al(^) - (c, = 

= — min min (u) = 

= — min At, (n) = 

= —a{c) . 
Similarly, one can check that a* — /3: 

a*(h) — max ((c,h) — a(c)) = 

ceHi(Af;K) 



max (cji) + min Ar (ii) I = 
ceHi(A/;R) V ' f.em{L) J 

max min (AL(a) + (c,h~p(n))) = 

ceHi(A/;R)peOT(L) 

min max (Al(u) + (c, h ~ p(n))) = 

Aie9Jl(L) ceHi(Af;R) 

min min max (A^f/i) + (c, /i — p)) 

peHi(A/;R) AieOTP(L) ceHi(A/;R) 



where in the second last line we could exchange the order of the max and the 
min, using a general result by Rockafellar, that requires concavity in one variable, 
convexity in the other one, and some compactness assumption (see |51l Section 
36]). Observe now that \i h ^ p, then maXcgHi(A/;R) (^-l(m) + (c, — p)) = +c». 
Therefore: 

cy*(h) = ... = min min max (AL(ii)-\-{c,h — p)) = 

peHi(Af;R) ti£miP(L) ceHi(M;R) 

min AL{p)^P{h). 

The second statement of this proposition follows from a general property of convex 
conjugation. Let (/j : — !■ M be a convex function on a finite dimensional vector 
space V and let (f* : V* — !• M U {+00} be its convex conjugate. Then (see [ST]): 
tp* is finite everywhere if and only if ip has superlinear growth, i.e., — > +00 
as ||a;|| — > +00. 

□ 

Next proposition will allow us to clearify the relation (and duality) between the 
two minimizing procedures above. To state it, recall that, like any convex function 
on a finite-dimensional space, /3 admits a subderivative at each point h € Hi(M; K), 
i.e., we can find c G H^(M;M) such that 

(17) V/i' e Hi(Af;M), P{h') - P{h) > {c,h' - h). 

As it is usually done, we shall denote by df3{h) the set of c € H-'^(M;K) that 
are subderivatives of (3 at h, i.e., the set of c which satisfy the inequality above. 
Similarly, we shall denote by da{c) the set of subderivatives of a at c. 
Fenchel's duality implies an easier characterization of subdifferentials. 



26 



ALFONSO SORRENTINO 



Proposition 4.24. c e d/3{h) if and only if {c,h) = a{c) + (3{h). Similarly h G 
da{c) if and only if {c,h) — a{c) + I3{h). In particular, c G d[3{h) if and only if 
h g da{c). 

Proof. We shall prove only the first statement. The second one is analogous and 
the third one a trivial consequence. 

[^] Using that I3{h') > {c,h') - a(c) for each h' G Hi(Af;M), it follows that for 
each h' € Hi(M;M): 

I3{h')-/3{h) > {c,h')-a(c)-f3{h) = {c,h')-{a(c) + f3{h)) = 
= {c,h') ~ {c,h) = {c,h' -h). 

[=>] It follows from Fenchel-Legendre inequality that a{c)+/3{h') > (c, h') for each 
h' G Hi(M;IR). Therefore we only need to prove the reverse inequality. In fact, 
using (jT?! one can deduce that for each h' G Hi(M;IR): 

a(c)+/3(/i) < a{c) + l3{h')-{c,h'-h)=a{c)+l3ih')-{c,h') + {c,h) = 

= (aic) + l3{h')-{c,h')^+{c,h). 

Therefore, taking the minimum over h' on the left-hand side we obtain: 

a{c)+P{h)< min (a{c) + l3{h') - {c,h')] + {c,h) = {c,h), 

/i'eHi(M;R) V / 

where in the last equality we used that min;j/gHi(M;R) (ck(c) + f3{h') — (c, ft,')) — 0, 
as it follows easily from Fenchel-Legendre duality. □ 

We can now prove that what observed in Remark |4.22| continues to hold in the 

general case 

Proposition 4.25. Let fi G 2t(i) be an invariant probability measure. Then: 

(i) Al(ij) = j3(p(^)) if and only if there exists c G H"'^(7\f;]R) such that fi minimizes 
Al^^ {i.e., AL^^ifj.) = -a(c)). 

(ii) If fj. satisfies Ai(/i) = f3{p(p)) and c G H^(Af;M), then fi minimizes A^ ^ if 
and only if c € d/3{p(fj,)) (or equivalently (c, h) = a{c) + /3(p(/i)). 

Proof. We shall prove both statements at the same time. Assume ^^(/io) = 
/3(p(Mo))- Let c G d/3{p{fio)), by Fenchel's duality this is equivalent to 

a(c) = (c,p(^o)) - /^(p(mo)) 

= (c,p(mo)) - Al{po) 

= -Al,^ (mo). 

Therefore A^^^ {po) = min^g9j;(i) A^^^ [p). 

Assume conversely that Ai^^^{pf)) = min^ggj;^^) ^/^^^ (/i), for some given coho- 
mology class c. Then, it follows that 

a{c) = -Al^^{po), 

which can be written as 

{c,p{p-o)) = a(c) + Al{po). 

It now suffices to use the Fenchel inequality {c, p{po)) < a{c) + /3{p{po)), and the 
inequality j3{p{po)) < Al{pq), given by the definition of /3, to obtain the equality 

{c,p{pa)) = a{c) + (3{p{poj). 

In particular, we have Al{po) — l3{p{po)). 

□ 



LECTURE NOTES ON MATHER'S THEORY FOR LAGRANGIAN SYSTEMS 



27 



Remark 4.26. (i) It follows from the above proposition, that both minimizing 
procedures lead to the same sets of invariant probability measures: 

/ieHi(M;R) cGHi(A/;K) 

In other words, minimizing over the set of invariant measures with a fixed rotation 
vector or minimizing - globally - the modified Lagrangian (corresponding to a cer- 
tain cohomology class) are dual problems, as the ones that often appears in linear 
programming and optimization. 

(ii) In particular, we have the following inclusions between Mather sets: 

c G d/3{h) ^ he da{c) M'' CMc- 

Moreover, for any c G H^(Af;M): 

heda(c) 

{Hi) The minimum of the a function is sometime called Mane's strict critical 
value. Observe that if q;(co) = mina(c), then G 9a(co) and /3(0) = — q;(co). 
Therefore, the measures with zero homology are contained in the least possible 
energy level containing Mather sets: M.^ C M.co- This inclusion might be strict, 
unless a is differentiable at Cq; in fact, there may be other action minimizing mea- 
sures with non-zero rotation vectors corresponding to the other subderivatives of a 
at Cq. 

{iv) Note that measures of trivial homology are not necessarily supported on 
orbits with trivial homology or fixed points. For instance, one can consider the 
following example (see also |161 Section 5.2]). Let M — equipped with the 
flat metric and consider a vector field X with norm 1 and such that its orbits 
form a Reeb foliation, i.e., X has two closed orbits 71 and 72 in opposite ho- 
mology classes and any other orbit asymptotically approaches 71 in forward time 
and 72 in backward time. As we have described in section |2] we can embed this 
vector field into the Euler-Lagrange vector field given by the Tonelli Lagrangian 
Lx{x, v) — ^\\v—X{x)\\'^. Let us now consider the probability measure /i^^ and /i^^, 
uniformly distributed respectively on 71 and 72. Since these two curves have oppo- 
site homologies, then pin-y^) — — p(a*72) ='■ ha ^ 0. Moreover, it is easy to see that 
^ix(A*7i) = ^Lx {1^12) = 0, since the Lagrangian vanishes on Graph(X). Using the 
fact that Lx > (in particular it is strictly positive outside of Graph(X)) and that 
there are no other invariant ergodic probability measures contained in Graph(X), 
we can conclude that A^o = 7i U72 and q;(0) — 0. Moreover, /ip :— |/i7i + 



zero homology and its support is contained in AAq. Therefore (see Proposition 4.25 
(i)), /Lto is action minimizing with rotation vector and M'^ C A^o! in particular, 
M.^ = TWq. This also impHes that /?(0) = and a(0) = mina(c) = 0. 
Observe that a is not differentiable at 0. In fact, reasoning as we have done before 
for the zero homology class, it is easy to see that for all t € [—1, 1] A^*'*" — A^g. 
It is sufficient to consider the convex combination ^\ — X^i-y-^ + (1 — A)/i-y, for any 
A e [0, 1]. Therefore, da{0) = {tho, t e [-1, 1]} and l3{tho) = for all t 1]. 



As we have just seen in item (iv) of Remark 4.26 it may happen that the Mather 
sets corresponding to different homology (resp. cohomology) classes coincide or are 
included one into the other. This is something that, for instance, cannot happen 
in the integrable case: in this situation, in fact, these sets form a foliation and are 
disjoint. The problem in the above mentioned example, seems to be related to a 
lack of strict convexity of /3 and a. See also the discussion on the simple pendulum 
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in Addendum 4.B: in this case the Mather sets, corresponding to a non-trivial in- 
terval of cohomology classes about 0, coincide. 

In the light of this, let us try to understand better what happens when a and /3 are 
not strictly convex, i.e., when we are in the presence of "/?af" pieces. 
Let us first fix some notation. If 1/ is a real vector space and vq,vi G V , we shall 
denote by a{vo, vi) the segment joining vq to vi, that is cr(wo, vi) :— {tvo + (l — t)vi : 
t € [0, 1]}. We shall say that a function / : V — !■ M is affine on a{vQ,vi), if there 
exists V* e V* (the dual of V), such that f(v) — f{vo) + {v*,v — vq) for each 
V e a{vo,vi). Moreover, we shall denote by lnt{a{vQ,Vi)) the interior of a{vQ,vi), 
i.e., lnt{a{vo,vi)) := {tvo + {1 - t)vi : t G {0, 1)}. 



Proposition 4.27. (i) Let ho, hi e IIi(7\f;IR). f3 is affine on a{ho,hi) if and only 
if for any h £ lnt{a{ho, hi)) we have M'' D M''° U M'^^ . 

(i) Let Co,Ci G II^(A/;IR). a is constant on ct(co,Ci) if and only if for any c G 
Int((T(co, ci)) we have Mc C Meg H Mci ■ 



Remark 4.28. The inclusions in Proposition |4.26| may not be true at the end 
points of cr. For instance. Remark 4.26| (iv) provides an example in which the in- 
clusion in Proposition 4.27 (i) is not true at the end-points of a{~hQ, ho). 



Proof, (i) [=^] Assume that /3 is affine on ct(/io, hi), i.e., there exists c G II^(Af ; M) 
such that f3{h) = /3{ho) + {c,h — ho) for all h G (j{ho, hi). 

For i — 0,1, let fii be an action minimizing measure with rotation vector hi. If 
t € (0, 1), let us consider fit '■= tfJ-i + (1 — i)A'o- Clearly, jo(/it) = thi + (1 — t)ho € 
lnt{a{ho,hi)), therefore f3{p{^t)) = /3{ho) +t{c,hi — ho). Then: 



L{x, v)dfit 



L{x,v)d{tfj,i + (1 - t)^o) 



TM 



TM 

— t L{x,v)diii + {1 — t) / L{x,v)dpo = 
Jtm Jtm 

= t(3ihi) + {l-t)l3iho) = 

= t{f3{ho) + {c,hi-ho)) + {l-t)f3{ho) = 

= P{ho)+t{c,hi-ho) ^ Ml^t))- 

Therefore /Xj is action minimizing with rotation vector thi -I- (1 — t)ho. Since this 
is true for any /z^ with rotation vector hi (i = 0, 1), it follows that: 

Since M'^ 3 M''° U M'^^ for all h e lnt{a{ho, hi)), using the observation 

we obtain that M'''" and M'^^ must be 



in Remark 



4.26 



(a) and Proposition 



4.25 



contained in A4co for some cq S H^(Af;]R). In particular, cq S dp (ho) 08/3 {hi). Let 
us show that cq € df3{h) for all h G lnt{a{ho, hi)). In fact, let h = thi + (1 — t)ho 
for some t G (0, 1). Then using the convexity of /3: 

a{co)+l3ih) = a{co) + Pithi + {1 ^ t)ho) < 

< t{a{co) + I3{hi)) + {l-t) (a(co) + /3(/io)) = 

< t{co,hi) + {I - t){co,ho) ^ 

= {co,thi + {l-t)ho) = {co,h). 

On the hand, the reverse inequality is always true (Fenchel-Legendre inequality). 
Now using this fact, it follows that li h G u{ho, hi) then: 

a(co) + PQi) = (co, h) and a[co) + (3(ho) = (cq, ho) 
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therefore subtracting the second equaHty from the first one, we obtain what we 
wanted: 

P{h) - l3{ho) = (co, h^ho) yhe a{ho, hi) . 
(ii) [<^=] It is a trivial consequence of Theorem 



4.13 



[=^] Let t £ (0, 1) and consider ct := tci + (1 — t)co. We want to show that for each 
h G da{ct) we have that (ci — cq, /i) =0. First observe that since ct G Int(cr(co, ci)), 
then there exists S > such that ct + s(ci — cq) € cr(co, ci) for all s £ {—6, 6). Then, 
using the fact that h G da{ct) and that a is constant in (t(co, ci), we obtain: 

= a(c( + s(ci - Co)) - a{ct) > s(ci - co,h) V s G (-(5, S). 

But this can be true only if (ci — cq, /i) =0. 

Now let us prove that, for z = 0, 1, da{ci) 3 9a(ct) for all t G (0, 1) . In fact, if 
h S da{ct), then using that (ci, h) — {cq, h) and that a is constant on (t(co, ci), we 
get: 

a(c,)+/?(/i) = a{ct) + P{h)^{ct,h) = 
= {tc, + {l-t)co.,h) = 
= t(ci,h) + {l-t){co,h) = 
= t{c,,h) + {\-t){c„h) = 
= {ci,h). 

This and Remark 4.26 (ii) immediately allows us to conclude that 
McCMc, fori = 0,1 ^ Mc'^Mco^^Mc-,- 

□ 

Remark 4.29. It follows from the previous remarks and Proposition |4.27| that, in 
general, the action minimizing measures (and consequentely the mather sets 
or A4^) are not necessarily ergodic. Recall that an invariant probability measure is 
said to be ergodic, if all invariant Borel sets have measure or 1. These measures 
play a special role in the study of the dynamics of the system, therefore one could 
ask what are the ergodic action-minimizing measures. It is a well-known result 
from ergodic theory, that the ergodic measures of a flow correspond to the extremal 
points of the set of invariant probability measures (see for instance |31|). where by 
"extremal point" of a convex set, we mean an element that cannot be obtained as a 
non-trivial convex combination of other elements of the set. Since /? has superlinear 
growth, its epigraph {{h,t) e Hi(A/;M) x M : t > l3{h)} has infinitely many ex- 
tremal points. Let (/i, (3(h)) denote one of these extremal points. Then, there exists 
at least one ergodic action minimizing measure with rotation vector h. It is in fact 
sufficient to consider any extremal point of the set {/i S DJl'^{L) : v4i(/i) — f3{h)}: 
this measure will be an extremal point of 9Jt(L) and hence ergodic. Moreover, as 
we have already recalled in Remark |4.14[ for such an ergodic measure /i, Birkhoff's 
ergodic theorem implies that /i-almost every trajectory of has rotation vector 
h. 



ADDENDA 

4. A - The symplectic invariance of Mather sets 

In this addendum we would like to discuss some symplectic aspects of the theory 
that we have started to develop. In particular, as a first step, we would like to 
understand how the Mather sets behave under the action of symplectomorphisms 
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(see also |S]). In order to do this, we need to move to the Hamiltonian setting, 
rather than the Lagrangian one, and consider the Hamiltonian H : T*M — > M, 
defined by Fenchel duality (see Section [2]) . Recall that the associated Hamiltonian 
flow (f>^ is conjugate to the Euler-Lagrange flow of L, therefore, from a dynamical 
systems point of view, the two systems are equivalent. We can define the associated 
Mather sets in the cotangent space as 

where £l '■ TM — > T*M is the Legendre transform associated to L (see (Q). 
These sets are non-empty, compact and invariant for the Hamiltonian flow and 
they continue to satisfy the graph property (see Theorems 4.12 and 4.201. 

The main advantage of shifting our point of view, is that the cotangent space 
T*M can be naturally equipped with an exact symplectic form cj = X^iLi dxihdpi = 
— rfA, where A = X^iLi Vi dxi is what is called the tautological form or Liouville form. 
Let ^ : T*Af — > T*M be a diffeomorphism. We shall say that vj/ is a symplec- 
tomorphism if it preserves the symplectic form w, i.e., = ui. An easy class of 
examples is provided by translations in the fibers. Let 77 be a closed 1-form and 
consider : T* M — > T*Af, {x,p) 1 — > {x,p + fjix)). Then, t is a symplectomor- 
phism. 

Observe that since uj = —dX, one has that d(^'*A — A) = 0; in other words, the 
1-form 4'* A — A is closed. We shall call the cohomology class of ^f, the cohomology 
class of ^'*A - A and denote it by [*] e Hi(T*M;M) ~ Hi(A/;M), since T*M can 
be retracted to M along the flbers (hereafter we shall always identify these two 
spaces). Obviously, going back to the previous example, [r^] ~ [rj]. In particular, 
^ is said to be exact if and only if [^f] — 0. 

Lemma 4.30. Any symplectomorphism ^' ; T* M — > T* M can be written as 
vj/ = $ o T,,, where $ is an exact symplectomorphism and [77] = [^']. 

Proof. Let rj be any closed 1-form on AI, such that [ry] ~ [^f], and define as 
above. Moreover, we define $ = ^E* o (t^)^^ = vI/ o t_,,. In order to conclude the 
proof of the Lemma, we need to check that <I> is exact. In fact, 

$*A = (* o T_^)*A = r*^(**A) = T%(A + 9) = A + T*,,e - r;, 

where [tI^^O] = [*] = [ryJ.Then, [$* A - A] = [9 - 77] = and hence it is exact. □ 

Therefore, if we want to understand the interplay between Mather sets and 
the action of symplectomorphisms, it will be sufficient to analyze the behaviour 
of these two kinds of symplectomorphisms: translations in the fibers and exact 
symplectomorphisms. 

Proposition 4.31. Let H : T*A/ — > R be a Tonelli Hamiltonian and rj a closed 
1-form on M . Then: 

M:{Hot^) = r_, Vc e Hi(A/;M). 

Remark 4.32. If ff is a Tonelli Hamiltonian, then also _ff o is a Tonelli Hamil- 
tonian (we are just composing it with a vertical translation in the fibers). 

Proof. Let us start by observing that the Lagrangian associated to H o is 
L — fj and that the associated Legendre transform Cl^ — o C (just 
derive with respect to v). Therefore, using the definition of Mather sets for a 
given cohomology class, we get: 

M:{Hot) -.^ Cl, [m.{L - r?)) = Cl, (7W,+[„](i)) = 
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□ 



Let us see now what happens with exact symplectoniorphisms (see also [54' ) . 

Proposition 4.33. Let H : T*M — > M 6e a Tonelli Hamiltonian and $ : 
T* M — > T*M an exact symplectomorphism such that H o ^ is still of Tonelli 
type. Then: 

X*(Fo$) = $-i(X*(iJ)) VcGH1(M;M). 

Remark 4.34. Observe that even if H is ToneUi, o $ is not necessarily of Tonelli 
type! 

This proposition can be easily deduced from the following Lemma (see also j54|). 

Lemma 4.35. Let H : T* M — > R be a Tonelli Hamiltonian and $ : T*M — > 
T* M an exact symplectomorphism, such that H' := H o ^ is still Tonelli. Then: 

(i) fi is an invariant probability measure of H if and only if is an invariant 
probability measure of H' ^ H o $; 

(ii) for any fi invariant probability measure of H , the following holds: 



(18) 



dfi 



- H'{x,p) 



d^^fi. 



Remark 4.36. The identity in ( 18 1 represents the equality between the associated 
Lagrangian actions (in the Hamiltonian formalism). Therefore, since the respective 
actions coincide on all measures and the invariant measures are in 1 — 1 correspon- 
dence, there must be a correspondence between the minimizing ones: fi is action 
minimizing for H if and only if is action-minimizing for H o From this. 
Proposition |4.33| follows easily. 

Proof. [Lemma 4.35| (i) The first part of the statement follows from the classical 
fact that $ tranforms the associated Hamiltonian vector fields in the following way: 

(19) Xff($(x,p)) ^ D^{x,p)Xho^{x,p) y{x,p) e T*M. 

(ii) If we denote by X{x,p) the Liouville form pdx, then: 



P^(a;,p) - H{x,p) 



d^ 



(^X{x,p)[Xh{x,p)] - H{x,pj^dfi. 



Therefore, using that |dct_D$| = 1, the relation in (19 1 and that $*A — A = df 
(since $ is an exact symplectomorphism), we obtain: 

P^{x,p) - H{x,p) d^i^ J i^X{x,p)[XHix,p)] - H{x,p)j d^i = 

<i>*X{x',p')[D<l>-'^{x',p')XH{<i>{x',p'))] - ff(4'(a;',p'))) d<^>* fi = 

{X{x',p') + df{x',p'))[XHo<s.{x',p')]-Hmx\p'))) d$> = 

X{x\p')[Xh'{x',p')]~H\x',p')) d<S>*fi + J df{x\p')[XH'{x',p')]d^*fi: 

p'-^{x',p')-H[x',p')) d<i>>. 

In the last equality we used that / df{x',p')[XH'{x',p')\d(^*^i = 0, as it follows 
easily from the invariance of <I>*/j,. For the sake of simplifying the notation, let us 
denote v := and assume that v is ergodic (otherwise consider each ergodic 
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component). Using the ergodic theorem and the compactness of the suppport of u, 
we obtain that for a generic point (a;o, j/o) in the support of v. 

df{x',p')[XH'{x',p')]dv = Km -/ d/($f (a;o,Po))[^ff'(1'f (a;o,Po))]di 

□ 

Finally, we can deduce the main result of this addendum. 

Theorem 4.37. Let H ■.T*M — > R be a Tonelli Hamiltonian and ^ : T* M — > 
T* M a symplectomorphisms of class [^], such that H o^! is of Tonelli type. Then, 



Proof. Suppose that \E' = $ o r^, with [q] = [^]. Then, using Propositions 



and |4.33| we get for all c € Hi(M; ] 

m:{ho^>) x:(i/o$oT„)-r_„(^x:+[„](Fo$)^ 



4.31 



□ 



Corollary 4.38. Let H : T*M — >Rhe a Tonelli Hamiltonian and ^ : T*A/ — 
T*M a symplectomorphisms of class [vt], such that Ho"^ is of Tonelli type. Then: 

(i) anoxic) ^aH{c+[^]) VceHi(M;M) 

(ii) Pno^ih) ^ l3H{,h) - m,h) V;^eHi(M;M). 



Proof, (i) From Theorem [437] it follo ws tha t if {x,p) E A4*(i?o*), then G 
A^*^j^j(i?). Therefore, using Theorem 4.13 for any {x,p) E A4*{H o v]/) we have: 

-aHo*(c) = iHo ^'){x,p) = H{^{x,p)) = -auic + 

(ii) Observe that \i h E daHo<5/{c), then h E danic + [^']). In fact, for every 
c'eHi(Af;M): 

anic' + [*]) - aH(c' + [f]) = affo*(c') - Q;i/o*(c) > (c' - c, /i) = 

= {ic' + m-{c^m,h). 

Let now /i € da no's/ (c). Using the fact that a and /3 are one the conjugate of the 
other, we get: 

Pho^Qi) = (c,h) - anoxic) = {c,h) - aH{c+ [^]) = 

= {c+[^,h)-aH{c+m-m,h) = 
= PH{h)-mh). 

□ 



We can summarize everything in the following commutative diagram. 
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T*M 



T*A/ 




Hi(Af;M) 



4.B - An example: the simple pendulum I 



In this addendum we would like to describe the Mather sets, the a-function and 
the /3-function, in a specific example: the simple pendulum. This system can be 
described in terms of the Lagrangian: 



L : TT 

{x,v) 



^\v\'^ + (1 - cos(27ra;)). 



It is easy to check that the Euler-Lagrange equation provides exactly the equation 
of the pendulum: 



V = 2Tr sin(27ra;) 



V = X 

X — 27r sin(27ra;) = 0. 




E>0 



Figure 1. The phase space of the simple pendulum. 
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The associated Hamiltonian (or energy) H : T*T — > M is given by H{x,p) := 
\ IpP — (1 — cos(27ra;)). Observe that in this case the Legendre transform £l{x, v) = 
{x,p), therefore we can easily identify the tangent and cotangent space. In the fol- 
lowing we shall consider TT ~ T*T ~ T x M and identify Hi(M; M) ~ Hi(M; R) ~ 
R. 



First of all. let us study what are the invariant probability measures of this 
system. 

• Observe that (0,0) and (^,0) are fixed points for the system (respec- 
tively unstable and stable). Therefore, the Dirac measures concentrated on 
each of them are invariant probability measures. Hence, we have found 
two first invariant measures: (5(0,0) ^^id (5(io), both with zero rotation 
vector: /o((5(o,o)) = P{^{^ o)) = 0. As far as their energy is concerned 
{i.e., the energy levels in which they are contained), it is easy to check 
that E{S(o,Q)) = H{0,0) = and ^^((^(1,0)) = ^^(5,0) = -2. Observe 
that these two energy levels cannot contain any other invariant probability 
measure. 

• If i5 > 0, then the energy level {H{x, v) = E} consists of two homotopically 
non-trivial periodic orbits {rotation motions): 



Ve ■■= {{x,v) : V = ±v/2[(l + i;)-cos(27ra;)], Va; € T}. 



The probability measures evenly distributed along these orbits - which we 
shall denoi 
denote by 



shall denote - are invariant probability measures of the system. If we 



(20) T{E) := / dx 

^2[{l + E) - cos(27rx)] 



the period of such orbits, then it is easy to check that (see Remark 4.14) 
p{n%) = Observe that this function T : (0, -l-oo) — > (0, -l-oo), which 

associates to a positive energy E the period of the corresponding periodic 
orbits V^, is continuous and strictly decreasing. Moreover, T{E) 00 as 
E' — >■ (it is easy to see this, noticing that motions on the separatrices take 
an "infinite" time to connect to 1 = mod.l). Therefore, p{ii%) — > as 
£;-> 0. 

• If —2 < < 0, then the energy level {H{x, v) ~ i?} consists of one 
contractible periodic orbit {libration motion): 

Ve-={{x,v): = 2(1 + £;) - 2cos(27ra;), a; G [i'b, 1 - x^]}, 

where xe '■= ^ arccos(l + E). The probability measure evenly distributed 
along this orbit - which we shall denote /i^ - is an invariant probability mea- 
sure of the system. Moreover, since this orbit is contractible, its rotation 
vector is zero: p{fJ-E) — 0. 
The measures above are the only ergodic invariant probability measures of the 

system. Other invariant measures can be easily obtained as convex combination of 

them. 



Now we want to understand which of these are action-minimizing for some co- 
homology class. 

Remark 4.39. (i) Let us start by remarking that for —2 < E < the support 
of the measure /i^; is not a graph over T, therefore it cannot be action-minimizing 
for any cohomology class, since otherwise it would violate Mather's graph theorem 
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(Theorems 4.12 and 4.20). Therefore all action-minimizing measures will be con- 



tained in energy levels corresponding to energy bigger than zero. It follows from 



Theorem [4l3| that Q!(c) > for all c G R. 

(ii) Another interesting property of the a function (in this specific case) is that 
it is an even function: a{c) — a(— c) for all c G M. This is a consequence of 
the particular symmetry of the system, i.e., L(x,v) — L{x,—v). In fact, let us 
denote r : T x K — > T x M, (x,v) i — !• {x,—v) and observe that if /x is an in- 
variant probability measure, then also r*/i is still an invariant probability measure. 
Moreover, T*2)t(i) ~ 97l(i), where DJl{L) denotes the set of all invariant prob- 
ability measures of L. It is now sufficient to notice that for each ^ G dJl{L), 
J {L — c ■ v) dii = J {L + c ■ v)dT* fi, and hence conclude that 

a(c) = — inf / (L ~ c ■ v) dii — — inf / (L + c- v)dT* u — a(~c) . 
m{L)J m{L)J 

(Hi) It follows from the above symmetry and the convexity of a, that mine a{c) = 
a(0). 

Let us now start by studying the 0-action minimizing measures, i.e., invariant 
probability measures that minimize the action of L without any "correction". Since 
L{x, v) >0 for each {x, t;) G T x M, then Al{h) > for all /i G DJl{L). In particular, 
^l(<^(o,o)) = 0> therefore (5(o.o) is a 0-action minimizing measure and a{0) = 0. 
Since there are not other invariant probability measures supported in the energy 
level {H(x,v) = 0} (i.e., on the separatrices) , then we can conclude that: 

-Mo -{(0,0)}. 



Moreover, since a'(p) = (see Remark 4.39 (m)), then it follows from Remark 4.26 
that: 

M° = Mo = mo)}. 

On the other hand, this could be also deduced from the fact that the only other 
measures with rotation vector 0, cannot be action minimizing since they do not 
satisfy the graph theorem (Remark [4.39 1. 



Now let us investigate what happens for other cohomology classes. A nai've 
observation is that since the a function is superlinear and continuous, all energy 
levels for > must contain some Mather set; in other words, they will be achieved 
for some c. 

Let E > and consider the periodic orbit and the invariant probability measure 
/i^ evenly distributed on it. The graph of this orbit can be seen as the graph of a 
closed 1-form ry^ := ^/2[{l + E) — cos(27ra;)] dx, whose cohomology class is 

(21) c+{E) := [r]+] = f ^y2[{l + E) - cos{2ttx)] dx, 



which can be interpreted as the (signed) area between the curve and the positive 
x-semiaxis. This value is clearly continous and strictly increasing with respect to 
E (for £; > 0) and, a.s E ^ 0: 

/•I , 4 

c+{E) — > / ^2[1 - cos(27rx)] = - . 

Jo 7^ 

Therefore, it defines an invertible function c+ : (0, -l-oo) — > (^, -|-(xi). 
We want to prove that /j,^ is c+ (i<^)-action minimizing. The proof will be an imita- 
tion of what already seen for KAM tori in Section |3] (see Proposition 3.4). 
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Let US consider the Lagrangian {x,v) L{x, v)—rf^{x)-v. Then, using Fenchel- 

Legendre inequahty ([s]) (on the support of fx^, because of our choice of 77^, this is 
indeed an equahty): 



L,j+ix,v)dfi+ = J {L{x,v) ~ r]+{x) ■ v) d^i+ = 

= J -H{x,7j+{x))d^i+ = -E. 

Now, let v be any other invariant probabiHty measure and apply again the same pro- 
cedure as above (warning: this time Fenchel-Legendre inequality is not an equality 
anymore!): 



> 



L^+{x,v)diy = J [L{x,v) — r]^{x) ■ v) di/ > 

j -H{x,ri+{x))dv = ~E. 

Therefore, we can conclude that /i^ is (i?)-action minimizing. Since it already 
projects over the whole T, it follows from the graph theorem that it is the only one: 

Mc+(E) ='Pe = ii^^^) ■ V = V2[(l + - cos(27ra;)], Va; G T}. 
Furthermore, since /^(/i^) — t{E) ' then: 

Similarly, one can consider the periodic orbit Vj^ and the invariant probabil- 
ity measure fi^ evenly distributed on it. The graph of this orbit can be seen as 
the graph of a closed 1-form 77^ := — ^2[(1 + E) — cos(27r.T)] dx = —i1e^ whose 



cohomolgy class is c (E) = —c^{E). Then (see also Remark 4.39 (m)): 

M^-i^E) ='Pe= : « = -v/2[(l + i^) - cos(27ra;)], Vx £ T}, 

and 

Note that this completes the study of the Mather sets for any given rotation 
vector, since 



±x , 1 £;-i.+oo , , / ±\ I 1 -E-i-q+ 

= ^7^, — ^ — ±00 and Pd^p) = — r — > 



What remains to study is what happens for non-zero cohomology classes in [— ^, 
The situation turns out to be quite easy. Observe that a{c^{E)) — E. Thefore, 
from the continuity of a it follows that (take the limit as — )■ 0): a(±^) — 0. 
Moreover, since a is convex and mina(c) — a(0) — 0, then: a{c) = on [— -, -]. 
Therefore, the corresponding Mather sets will lie in the zero energy level. From 
the above discussion, it follows that in this energy level there is a unique invariant 
probability measure, namely (5(o,o)) s-nd consequently: 

7Wc = {(0,0)} for all - - < c< -. 



Let us summarize what we have found so far. Recall that in ( 20 1 and (|21| we have 
introduced these two functions: T : (0, +00) — > (0, +00) and c+ : (0, +00) — > 
{^^+oo) representing respectively the period and the "cohomology" (area below 
the curve) of the "upper" periodic orbit of energy E. These functions (for which 
we have an explicit formula in terms of E) are continuous and strictly monotone 
(respectively, decreasing and increasing). Therefore, we can define their inverses 
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which provide the energy of the periodic orbit with period T (for all positive periods) 
or the energy of the periodic orbit with cohomology class c (for |c| > ^). We shall 
denote them E{T) and E{c) (observe that this last quantity is exactly the — q;(c)). 



Then: 




Figure 2. Sketch of the graphs of the a and /3 functions of the 
simple pendulum. 

Observe that the a function is . In fact, the only problem might be at c = ±-, 
but also there it is differentiable, with derivative 0. If it were not differentiable, 
then there would exist a subderivative h ^ and consequently TM'' C which 
is absurd since the set on the right-hand side consists of a single point. However, 
a is not strictly convex, since there is a flat piece on which it is zero. 
As far as /3 is concerned, it is strictly convex (as a consequence of a being C^), but 
it is differentiable everywhere except at the origin. At the origin, in fact, there is 
a corner and the set of subderivatives {i.e., the slopes of tangent lines) is given by 
9/3(0) = [— ^, (this is related to the fact that a has a flat on this interval). 



4.C - HOLONOMIC MEASURES AND GENERIC PROPERTIES 

In this addendum we would like to stress that using the above approach the 
minimizing measures are obtained through a variational principle over the set of 
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invariant probability measures. Because of the request of "invariance", this set 
clearly depends on the Lagrangian that one is considering. Moreover, it is somehow 
unnatural for variational problems to ask "a-priori invariance". What generally 
happens, in fact, is that invariance is obtained as a byproduct of the minimization 
process carried out. 

An alternative approach, slightly different under this respect, was due to Ricardo 
Mane [33j (see also ^34j). This deals with the bigger set of holonomic measures (or 



closed measures, see Remark 4.40 1 and prove extremely advantageous when dealing 
with different Lagrangians at the same time. In this addendum we want to sketch 
the basic ideas behind it. 

Let Cg be the set of continuous functions / : TM — > M growing (fiberwise) at 
most linearly, i.e., 

II ,-11 fi^i 1^) 

\\f\\e-= sup -^^^<+^, 

{x,v)eTM J- + ll^l 

and let S[t|,/ be the set of probability measures on the Borel cr-algebra of TM such 
that JrJ,J^.J ||u|| d/i < oo , endowed with the unique metrizable topology given by: 

f{x,v)dfin — > / f{x,v)dn yfeC". 

TM JTM 

Let (C°)* be the dual of C". Then 9?t^^ can be naturally embedded in (C°)* and 
its topology coincides with that induced by the weak* topology on (C°)*. One can 
show that this topology is metrizable and a metric is, for instance: 



\\v\\ dfii - / ||v|| d^2 

TM JTM 



E 



TM JTM 



where {(pn}n is a sequence of functions with compact support on , which is 
dense on (in the topology of uniform convergence on compact subsets of TM) 
and c„ := suprpj\^ |(/j„(a:, u)|. The space of probability measures that we shall be 
considering is a closed subset of 9Jt^ (endowed with the induced topology), which 
is defined as follows. If 7 : [0, T] — M is a closed absolutely continuous curve, let 
/Lt^ be such that 

f{x,v)dfi,^^ f{j{t),j{t))dt \ffeC°. 



TM 

I 



Observe that [i^ e because if 7 is absolutely continuous then J Y)(t) \ dt < +00. 
Let C(M) be the set of such /i^'s and C(M) its closure in 9Jt^,/. This set is convex 
and it is called the set of holonomic measures on M. 
One can check that the following properties are satisfied (see |34|): 



i) dJl{L) C C{M) C dJlj^j. In particular, for every Tonelli Lagrangian L on 
TM, all probabilities measures /x that are invariant with respect to the 
Euler-Lagrange flow and such that /p^^j Ldfj, < +00, are contained in C{M). 

ii) To any given probability /i G C{M), one can associate a rotation vector 
p(/i) e Hi(M;M). This map extends continuously to a map 

p: C{M) — ^Hi(A/;M) 

and this extension is surjective. 

iii) For each C e M the set |^ G C(M) : ^l(m) < is compact. 

iv) If a measure ji e C(M) satisfies 

Al{p:) = min [Al{v) : v e C(M)} , 
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then /i g DJl{L) (and in particular it is invariant). Observe that the exis- 
tence of probabilities attaining the minimum follows from iii) . 
In view of these properties, it is clear that the corresponding minimizing problem, 

although on a bigger space of measures, will lead to the same results as before and 

the same definition of Mather sets. 

Remark 4.40. One can define the set of closed measures on TM as: 

/C(TAf) |/i e mij such that J df{x) ■vdn = 0\ff e C\M)^ . 

It is easy to verify that holonomic measures satisfy Proposition |4.7| and therefore 
C{M) C /C(TM). It is definitely less trivial to prove that indeed these two sets 
coincide: C(M) C /C(TAf). Although this was originally noticed by John Mather, 
as far as I know it has never been published by the author. A proof of this result 
may be found in jlOj . 



As we have already pointed out, this different approach is more suitable for 
working with different Lagrangians, for instance if one wants to study properties of 
family of Lagrangians or want to do some sort of perturbation theory. 
Using these ideas, Ricardo Mane [Sj showed that one can prove much stronger re- 
sults if, instead of considering ALL Lagrangians, one considers generic Lagrangians. 

Definition 4.41. A property P is said to be generic (in the sense of Mane) for a 
Lagrangian L if there exists a residual set (i.e., dense Gg set) Sl ^ C^(A/), such 
that if U £ Sl then L + U satisfies the property P. 

Theorem 4.42 (Marie). For a fixed c E I1^{M;M.), having a unique c-action 
minimizing measure is a generic property in the sense of Mane. In other words, 
for any Tonelli Lagrangian L, there exists a residual subset Sl Q C^{M), such that 
for each U £ Sl, the Lagrangian L + U has a unique c-action minimizing measure. 

This result has been recently improved by Patrick Bernard and Gonzalo Contr- 
eras [IT] : 

Theorem 4.43 (Bernard-Contreras). The following property is generic in the 
sense of Mane: for all c G H^(il/;M), there are at most 1 -|- dimH^(Af;IR) ergodic 
c-action minimizing measures. 

5. Global action minimizing curves: Aubry and Mane sets 

In the previous section we have described the construction and the main prop- 
erties of the Mather sets. One of the main limitations of these sets is that, being 
the support of invariant probability measures, they are recurrent under the flow 
(Poincare recurrence theorem), i.e., each orbit after a sufficiently long time (and 
therefore infinitely many often) will return arbitrarily close to its initial point. This 
property excludes many interesting invariant sets, which are somehow "invisible" to 
such a construction; for instance, think about the stable and unstable manifolds of 
some hyperbolic invariant set, or about heteroclinic and homoclinic orbits between 
invariant sets. 

In this section we shall construct other (possibly) "larger" compact invariant sets 
and discuss their significance for the dynamics: the Aubry sets and the Mane sets. 
The key idea is the same as we have already explored in Section |3j instead of con- 
sidering action minimizing invariant probability measures, one can look at action- 
minimizing curves for some modified Lagrangian. We showed in Section [s] (see 



Remarks 3.9 and 3.121 that orbits on KAM tori could be characterized in terms of 
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this property. In this section we shall mimic that construction in the general case 
of a Tonelli Lagrangians. 

In the light of Lemma [4!6] and the discussion in Section|4j let us fix a cohomology 
class c € H-'^(Af;M) and choose a smooth 1-form ry on M that represents c. As we 
have already pointed out in Section [2] there is a close relation between solutions of 
the Euler-Lagrange fiow and extremals of the action functional A^^ for the fixed 
end-point problem (which are the same as the extremals of A^). In general, these 
extremals are not minima (they are local minima only if the time length is very short 
|22l Section 3.6]). One could wonder if such minima exist, namely if for any given 
end-points x,y € M and any given positive time T, there exists a minimizing curve 
connecting a: to y in time T. From what already said, this curve will correspond 
to an orbit for the Euler-Lagrange flow. Under our hypothesis on the Lagrangian, 
the answer to this question turns out to be affirmative. This is a classical result in 
calculus of variations, known as Tonelli Theorem. 

Theorem 5.1 (Tonelli Theorem, H^). Let M be a compact manifold and L a 
Tonelli Lagrangian on TM . For all a < b and x,y € M , there exists, in the set 
of absolutely continuous curves 7 : [a, b] — > M such that 7(a) = x and 7(6) — y, a 
curve that minimizes the action Al^{'-^) = L^(7(i), 7(t)) dt. 

Remark 5.2. (i) A curve minimizing ^^77(7) = -^ij (7(^)7 7(0) '^^ subject to the 
fixed end-point condition 7(a) = x and 7(6) = y, is called a c-Tonelli minimizer. 
Recall that such minimizers do only depend on c and not on the chosen represen- 
tative rj. In fact, adding an exact 1-form df to L will contribute with a constant 
term /(y) — f{x), that does not play any role in selecting the minimizers (see also 
Proposition |4.7[ ) . 

(m) As Mane pointed out in [35], for these minimizers to exist it is not necessary 
to assume the compactness of M: the superlinear growth condition with respect to 
some complete Riemannian metric on M is enough. 

{iii) A Tonelli minimizer which is is in fact C (if the Lagrangian L is C) 
and satisfies the Euler-Lagrange equation; this follows from the usual elementary 
arguments in calculus of variations, together with Caratheodory's remark on differ- 
entiability. In the autonomous case, Tonelli minimizers will be always C^. In the 
non-autonomous time-periodic case (Tonelli Theorem holds also in this case |42|'). 
as already remarked in remark |2.2[ one needs to require that the Euler-Lagrange 
flow is also complete. 

We shall sketch here the proof of Tonelli Theorem. We refer the reader to \A2\ 
Appendix 1] for more details. A new shorter proof of this theorem can be found in 

m- 

Proof. [Tonelli Theorem] The proof of this theorem follows from the following 
result (by C""^ we denote the set of absolutely continuous functions). 

Lemma. Let K eM.. The set Sk := {7 e C°'=([a, 6], M) : ^1,^(7) < K} is compact 
in the C'^ topology. 

First let us see how to obtain Tonelli Theorem from this Lemma. Let fco := 
mi{Ai^^{j) : 7 e C""^([a, 6], M)}. Observe that fco > —00 since L^ is bounded 
from below. Therefore, for any K > ko, Sk 7^ and it is compact because of the 
Lemma. Moreover, Sk ^ Sk' ii K < K'. Hence: 

f] Sk^^ 

K>ko 
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and any element in this intersection is a c-Tonelli niininiizer. 

The proof of the above lemma consists of several steps (see |3?, Appendix 1] for 
the missing details). 

- The first step is the observation that the family of curves in Sk is absolutely 
equicontinuous, i.e., for every £ > there exist S > such that if a < 
ao < bo < ai < bi < . . . < Qn < bn < b and X]"=o(^2 ~ ^i) < then 
X]r=o ^(7('^j)) 7(^j)) < ^- For this, one needs to use the superlinearity of L. 

- Now, we can apply Ascoli-Arzela theorem to deduce that every sequence 
{7n}n in Sk has a convergent subsequence, with respect to the topol- 
ogy. Moreover, it follows easily from the definition of absolutely equiconti- 
nuity, that the limit of any convergent subsequence must be also absolutely 
equicontinuous . 

- The last, and more involved, step is to show that if 7 is the limit of a 
sequence {jn}n in Sk, then 7 e Sk, namely ^^^^(7) < K. See (13 pages 
199-201]. 

These three steps conclude the proof of the lemma. □ 

Remark 5.3. Observe that the lemma used in the proof of Tonelli theorem is a sort 
of semicontinuity result for the Lagrangian action (compare with Proposition |4.3| . 
In fact, it implies that if {'jn}n is a sequence in C""^([a, &], M) which converges to 
7 in the C" topology, then 7 e C"''=([a, b],M) and Al^{j) < liminf„^+oo ^L^(7n)- 

In the following we shall be interested in particular Tonelli minimizers that are 
defined for all times and whose action is minimal with respect to any given time 
length. We shall see that these curves present a very rich structure. 

Definition 5.4 (c-minimizers). An absolutely continuous curve 7 : M — !• M is 
a c-{global) minimizer for L, if for any given a < 6 G M 

AL,{l\[a,b]) =mmAL„{cT) 

where the miminimum is taken over all a : [a, b] — > M such that cr(a) ~ 7(a) o,nd 
aib)^j{b). 

We have already seen in Section [3] that one can give an a-priori stronger notion 
of minimizer, asking that the minimum is realized amongst all curves connecting 
the two end-points, independently of their time length. 

Definition 5.5 (c-time free minimizers). An absolutely continuous curve 7 : 
M — > M is a c-time free minimizer for L, if for any given a < G M 

^L,(7|[a,fe]) =minAL,((T) 

where the miminimum is taken over all a : [a', b'] — >■ M such that a(a') = 7(a) and 
a(&')-7(&)- 

Remark 5.6. (z) We have proved in section [s] that orbits on KAM tori satisfy this 



stronger condition, modulo adding a constant to the Lagrangian (see Remark 3.9 1 
In fact, it is quite easy to see that this condition is "sensitive" to the addition of con- 
stants to the Lagrangian (although this is something totally irrelevant for being or 

not a c-minimizer) . For example, suppose that -^77(7, 'i)dt < Lr,{(J, a)dt with 

T' <T and let fc be a constant such that k > y,^^ ^ jj" L,i{a, a)dt — ir;(7: 'y)dt^ 
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Then, adding k to the Lagrangian, we even reverse the inequahty: 

AL,+kh) = f L^ii,i)dt + kT= [ L,,i-f,^)dt + k{T^T') + kT' > 





> / L^(7,7)dt+ / L^{a,&)dt- [ L^i-f,^)dt + kr 
Jo Jo 

^ [ L^{(j,a)dt + kT' ^ AL,^+k{a). 
Jo 

(ii) Obviously a c-time free minimizer is also a c-mininiizer. Fathi [201 proved 
that in the autonomous case, modulo adding the (unique) right constant, these two 
notions of minimizers indeed coincide: i/7 be a c-minimizer for L, then, 7 is c-time 
free minimizer for L + a(c), where a is the a-function associated to L. We proved 
this in the special setting of Section [s] (see Proposition 3.8). We shall discuss the 
general case in Section [6] 

(Hi) The equivalence between these two notions of minimizers is not true anymore 
when we consider time-periodic Tonelli Lagrangians (see |25]). Tonelli Lagrangians 
for which this equivalence result holds are called regular. Patrick Bernard [5| showed 
that under suitable assumptions on the Mather set it is possible to prove that the 
Lagrangian is regular. For instance, if the Mather set Aic is union of 1-periodic 
orbits, then is regular. This problem turned out to be strictly related to the 
convergence of the so-called Lax-Oleinik semigroup (see |22| and Section [6] for its 
definition) . 

Now we shall study the existence and the properties of c-minimizers and c-time 
free minimizers. There are two equivalent approaches that one can pursue: one is 
essentially due to Ricardo Mafie [35, 14 , while the other has been developed by 
John Mather [JJ. In the following, in order to keep the analogy with the cartoon 
example discussed in Section [3] we prefer following the first of these two approaches. 
We shall discuss Mather's approach in an Addendum 5C at the end of this section. 

Given any x,y € M and T>0, let us denote by CT{x,y) the set of abso- 
lutely continuous curves 7 : [0, T] — > M such that 7(0) — x and 7(T) = y. 
Tonelli Theorem implies that there exists 7„im S C'Tix,y) realizing the minimum, 
i.e., AL^iciram) = ™^'^-y£CT{x,v) ^L^il) ■ Our goal here is to study the existence 
of c-time free minimizers for L. For, let us fix fc € K and consider the following 
quantity: 

'/'r,,fc(2:,2/) = inf min +fc(7) e M U {-00} . 

T>0-i£CT(x,y) 

This quantity is commonly called Mane potential (compare with ([9| in Section |3|. 
First of all we would like to understand when it is finite and what are its properties. 
Let us introduce what is called Mane critical value. 

Definition 5.7 (Mane critical value). 

c{Lfj) :— supj/c G M : 3 a closed curve 7 s.t. ^l^+*;(7) < 0} = 
= infj/c G M : V closed curves 7 s.t. A^^^-^ki"/) ^ 0}. 

Remark 5.8. (i) It is easy to check that c(i^) < 00. In fact, since L is superlinear, 
there exists a sufficiently large k such that L -|- fc > everywhere. 
(ii) Moreover c(L,,) only depends on c = and not on the chosen representative. 
In fact, it is sufficient to notice that the integral of exact 1-forms along closed 
curves is zero. We shall see in the following that this "critical value" is something 
that we have already met before: c(L^) = a(c), where a is Mather's a-function 
associated to L. In Section|6]we shall also point out its relation to viscosity solutions 
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and subsolutions of Hamilton-Jacobi equation and the critical value introduced by 
Lions, Papanicolau and Varadhan in |32] . 

Proposition 5.9 (See also |14|). 



(1) 


Vfce 


R : 




z) + (/)r,,fc(z,?/) 


y x,y, z G M. 


(2) 


lfk< 








y x,y £ M. 




Ifk> 








yx,y e M. 


(3) 


Ifk> 




: M X M — ^ I 


^ is Lipschitz. 




(4) 


Ifk> 


c(L,,) 


(j>,^A^,x) = 




Vx e M. 


(5) 


Ifk> 






x)>0 


W x,y e M. 




Ifk> 






x)>0 


W x^y e M. 



Proof. (1) First of all observe that this inequality makes sense also if 4>ri.k{x, y) = 
— oo for some x,y € M . Let 71 G Ct{x^ z) and 72 S Ct' {z^ y) and consider the new 
curve obtained by joining them: 71 * 72 G CT+T'{x^y). Since the action is linear, 
it follows that Al,(7i * 72) = ^l^(7i) + ^l„(72) and therefore 

'/'r,,fe(a;,y) < AL,(7l)+^L„(72)• 
It is now sufficient to take the infimum over all possible (71, T) and (72, T') to 
conclude that 

(l)r,,k{x,y) < (j)nA^^z) + (j),-iAz,y)- 

(2) We shall first prove that if A: < c(L,,) there exists xq G M such that 

= —00. In fact, from the definition of c{Ln), we know that there 
exists 7 : [0,r] — > M closed curve with ^^,^(7) < 0. Let us denote by 7" the 
n-time iteration of 7, ie., 7" := 7 * . . . * 7 (n times). Then, 

</>,,fe(7(0),7(0)) < AL^ir) = nAi„(7) "-^ -ex.. 

Choose xq := 7(0) (or any other point on 7). The first claim will now follow from 
(1). In fact, if x, y G M, then: 

0>),/c(a;,2/) < (j>rj,k{^-^o) + (t>n.k{xo,xo) + (f)rjA^o,y) = -00 • 

As for the second claim, if fc > c(L,,) it follows from the definition of c(i,,) that all 
closed curves have positive action and therefore fe(a;, a;) > for all x G M. But, 
if there existed x^y £ M such that (f)ri,kix,y) = —00, then applying (1), we would 
get a contradiction: 

0r,,fe(a;, X) < 4>r,^k{x, y) + 0,,,fc(y, X) = -00 . 

Therefore, (f)rf^k{x,y) > —00 for all x, y G Af if fc > c(L). 

(3) Let fc > c{Lri) and let Q := max^gM.||u||=i L{x,v). For any x,y € M let us 
consider the unit speed geodesic connecting x to y, j^^y : [0, d{x, y)] — > M. Then: 

0j,,fe(2;,y) < ^L„(7x,y) < {Q + k)d{x,y) . 
Using (1) we can conclude: 

fe (2^2,^2) - 4'nM{xi,yi) = 4>,jAx2,Xi) + </>,,, fe(a;i, 2/1) + (/'^,fc(yi, ^2) - 0>,,fc(a;i, yi) < 

< {Q + k)[d{xi,X2) + d{yi,y2)]. 

(4) It follows immediately from (3). 

(5) The first part is a consequence of (1) and (4). Let us prove the second part. 
Assume that fc > c(i,,) and suppose by contradiction that there exist x ^ y E M 
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such that (pr,,k{x,y) + (t)r),k{y,x) = 0. Consider 7„ G CT„{x,y) and C7„ € Cs„{y,x) 
such that: 

hm AL^ijn) = (j)r,,k{x,y) and Hm AL^{a„) = (j)n,kiy,x). 

Let us prove that T := hminf„_>.+oo T„ > (it might be +oo). Suppose by con- 
tradiction that Um inf T„ = and select a subsequence {jnk } such that 
T„j.) — > 0. Using the superlinearity of L, we know that for each A > there 
exists B{A) such that Lr, > A\\v\\ - B{Ay, then: 

4>ri,k{x,y) = hm / L^(7„^,7„Jdt + A;T„^ > 

> lim A / ||7„J|rft + T„,(fc-B(A)) 
= Ad{x,y). 

From the arbitrariness of A it follows that 4>ri,k{x, y) = +oo, that is a contradiction. 

Therefore, lim inf „^_|_oo > 0. 

Analogously one can prove that S : — liniinfyj^_|_QQ S'^ > (it might be +cxd). 
Choose now subsequences {7^^} and {(Jmk} such that Tn^ — >■ T > and Smk 
S > 0. Using the fact that k > c{L,j) and the fact that x y E M arc such that 
'Pri k{x, y) + 4>ri k{y, x) = 0, wc obtain a contradiction to (4) (or to the definition of 
ciLr,)): 

4'v,c{Lr,)ix, X) < ^ Hrn^ ^L„+c(LO (7nfc * CTm J < 

< lim ^L„+fc(7«*,*cr„J+ lim (c(i^) - A:)(T„, + S"™ J = 
= <^r,,fc(a;,y) + '/>r,,fc(y,a;)+ lim {c{L^) - k){Tn^ + S^^) = 

AC— >-+00 

= (c(L^)-A:)(T + S) <0 (or-oo). 

□ 

Remark 5.10. It follows from (2) that c(L^) can be equivalently defined as: 

c{Ln) := mi{k gM. : 3 x,y G M s.t. ^^,fe(a;, ?/) > — oo} = 
= sup{fc e K : 3 a;, y e M s.t. ^^,fe(a;, ?/) = — oo}. 

In terms of Maiie potential, being a c-time free minimizer for L + k can be 
rewritten as: 

Va<6 / i^(7(t),7(i))rft+(6-a)fc = 0^,fc(7(a),7(6)). 

J a 

Of course, it does not make any sense to consider k < c{Lrj). Let us consider 
k > c{Ln). 

Proposition 5.11. Let k > c{Ln). For all x,y G M with x ^ y, there exists T > 
and 7 e CT{x,y) such that AL^+k{'y) = 4>r,^k{x,y). 

Proof. Let define for T > the function /(T) := i'm\^i^_CT(x,y) -^Lr^+kil)- This 
function is clearly continuous (for all k > c{Ln)) and the following properties hold. 

• /(T) — >• +0O as < — >■ 0+ (this is true for all k > c{Lr,)). In fact, let 7t be 
the corresponding Tonelli minimizer connecting x to y in time T. Using 
the superlinearity of L, for each A > Q there exists B = B{A) such that 
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L{x,v) > A\\v\\ - B for all [x,v). Then: 

/(T) min AL^+k{l)=AL^+k{lT)> 

'y£CT(x,y) 



> A [ W^tW dt + {k - B)T > 
Jo 



= Ad{x,y) + {k-B)T'^^'' Ad{x,y). 

Since ^ > is arbitrary and x ^ y then we can conclude that /(T) 
+00. 

• /(T) — > +00 as i — > +00 (this is true only for k > c{Lri)). In fact: 



fiT) = min AL^+kh) 



> 



min ,^L^+c(L,)(7) + (fc-c(ir,))T> 
0i,,c(L„) (a;, y) + {k - c{Lr,))T +00. 



□ 



Remark 5.12. Hence if fc > c{Ljj), c-tinie free niinimizers are not so special, 
since there are time free minimizers for L + k connecting any two given points, 
furthermore in a finite time. In the light of this (and other " a-fortiori^ reasons), 
one should probably be more interested in studying the "critical" case k = c^L^), 
i.e., c-time free minimizers for L + c{Lrj), that is for the least possible value of k 
for which they can exist. 

Definition 5.13 (c semi-static curves). We say that 7 : M — > M is a c semi- 
static curve for L if: 

l-b 

i.,(7W, 7(0) dt + c{L,,){b -a) = 0r,,c(L,) (7(a), 7W) V a < 6. 

Remark 5.14. (i) If 7 is c semi-static for L, then it is a c-time free minimizers for 
L + c{Lj-i) and consequently a c-global minimizer for L. Therefore, it corresponds 
to a solution of the Euler-Lagrange flow of L. 

(a) We shall prove in the following that for autonomous Tonelli Lagrangians, the 
converse is true: each c-global minimizer of L is indeed a c semi-static curve of 
L + c{Lrj) = L + a{c), where a denotes Mather's a function associated to L (see 
( [T3| in Section |4|. 

(Hi) In SectionTs] we proved that orbits on a KAM torus of cohomology class c, 
are c-time free minimizers for L + Ec, where Ec denoted the energy of the torus. 
It follows from Proposition 3.10 and the definition of Mane critical value (see also 
Remark 5.101, that in this case Ec — c{Lc). Therefore we can conclude that orbits 
on KAM tori are c semi-static. In particular, we can restate Remark 3.9 (Hi) saying 
that if we have a KAM torus T of cohomology class c, then 

C^^iT) = [J{h{t),'j{t)) : 7 is c semi-static for L and t G M}, 

where C denotes the Legendre transform given by L. 

Inspired by the last remark, we can define the following set. 

Definition 5.15 (Mane set). The Mane set (with cohomology class c) is: 

Afc = 1^ {(7(^)7 7(0) ■ J is a c semi-static curve andt G M} = 

(22) ~ (^{(7(^)77(0) ■ J is a c-global minimizer andt E M} . 
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Remark 5.16. The second equality in definition follows from Remark 5.14 and will 
be proved later on. Observe that so far we have not proved that such semi-static 
curves exist nor that this set is non-empty. We shall prove it later, deducing it - 
amongst other properties - from analogous results for another family of sets that 
we are about to define: the Aubry sets. However, if such set is non-empty, it is 
clearly invariant (it is union of orbits) and also closed (the proof follows the same 
line as Tonelli Theorem). 

Let us start by recalling what happened in the case of orbits on a KAM torus. 
We saw in Section |3] that these orbits were not only c-global minimizers (or c 



semi-static), but they also satisfied a stronger property, stated in Proposition 3.11 
Roughly speaking, the action of Lc -|- -Ec on a piece of curve between two endpoints 
X and y, was not only the minimal needed to connect x to y, but it was also equal 
to minus the minimal action to connect y back to x. We called a curve satisfying 
such a condition a regular minimizer. Recall, in fact, that, as it follows easily from 



Proposition 5.9 (5), for each x,y e M we have 4>rj,c{L^)ix,y) > ~(t)ri,c{L^)iy, x). 



Let us define such curves in the general case. 

Definition 5.17 (c static curves). We say that 7 : M — > M is a c static curve 
for L (or a "c-regular minimizer") if: 

l-b 

L,,{-f{t),j{t)) dt + c{Lr,){b - a) = -<^„,c(L,) (7(6), 7(a)) V a < 6. 

Remark 5.18. (i) If 7 is c static for L, then it is a c semi-static (and therefore, as 
already observed before, it corresponds to a solution of the Euler-Lagrange flow of 
L). It just aconsequence of the fact that —0^,,(^^^-)(7(6), 7(a)) < 0^ (7(a), 7(&)) 
and therefore if 7 is c-static then: 

Ln{l{t)n{t)) dt + c{L^){b -a)< (7(a), 7(6)) V a < 6. 

Since (/)^ ^(l^) (7(1)7 7(^)) was defined as the minimum over all connecting curves, 
then equality must hold. 

(m) Observe that the adjective regular in the alternative appelation (coined by John 
Mather) has no relation to the smoothness of the curve, since, like all solutions of 
the Euler-Lagrange flow, this curve will be as smooth as the Lagrangian. 
(Hi) In Section [3] (Proposition 3.11 and Remark 3.121 we proved that orbits on 



a KAM torus of cohomology class c, were c-static curves. Recall in fact that, as 
remarked before, Ec, which in that case denoted the energy of the torus, coincides 



with c{Lc) (use Proposition 3.10 and the deflnition of Mane critical value or Remark 



5.10 1. In particular, we can restate Remark 3.12 (ii) saying that if we have a KAM 



torus T of cohomology class c, then 

C^^iT) = |J{(7(i),7(0) : 7 is c-static for L and ^ G M}, 
where C denotes the Legendre transform given by L. 

(iv) The names semi-static and static are probably inspired by the fact that in the 
case of mechanical Lagrangians (see Section [2|, 0-static curves correspond to "some" 
flxed points of the flow (namely the minima of the potential), while 0-semi static 
curves may possibly include also hetero/homoclinic connections amongst these flxed 
points (see Addendum 5B on the pendulum). 

Inspired by the last remark, we deflne the following set. 

Definition 5.19 (Aubry set). The Aubry set (with cohomology class c) is: 

(23) Ac = {(7(^)1 7(^)) ■ 'y is a c static curve and t G M} . 
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The projection on the base manifold Ac = ti" y-^cj ^ M is called projected Auhry 
set (with cohomology class c). 

Remark 5.20. Observe that so far we have not proved that this set is non-empty! 
We shall do it now. However, if such set is non-empty, it is clearly invariant (it is 
union of orbits) and also closed (the proof follows t he sa me line as Tonelli Theorem) . 
Moreover, Ac is clearly contained in Afc (Remark 



5.18 



We summarise in this diagram what we are going to prove in the remaing of this 
section. 

Theorem 5.21. [^(1), (2), (3), (4), (5) and (6) in the following diagram are true. 



Mc 







A 








(5) 




(6) 




1 ^ 





c K c £c:^{E{x,v)^a{cpc{L,)} <= 



TM 



Mc c Ac 



M 



Remark 5.22. (i) It follows from (1), (2) and the existence of c-action minimizing 



measures (Corollary 4.5) that the Aubry and Mane sets are non-empty. Therefore, 



there exist semi-static and static curves. 

(a) Inclusion (2), as already observed, follows obviously from the fact that static 



curves are also semi-static (Remark 5.18 (i)) 



Ad- 



(iii) The above inclusions (1) and (2) may not be strict (see Remark 5.42 
dendum 5B). 

{iv) Since Ac and Afc are closed, it follow from (3) that they are compact. 
(v) The proof of (3) provides a proof of Carneiro' s theorem stated in Section |4] 



(Theorem 4.13) 



(m) Properties (5) and (6) are what are generally called Mather's graph theorem(s). 
Namely, the Mather set and the Aubry set are contained in a Lipschitz graph over 
M. This is probably the most important property of these sets and it has many 
dynamical consequences. In some sense, this is why they can be thought as gener- 
alization of KAM tori (or Lagrangian graphs) . 

(vii) The graph property does not hold in general for the Mane set (see Addendum 
5B on the pendulum). 

Let us start by proving that c semi-static curves have energy c(L,,). As we 
already remarked above, the original version of this theorem (with c(i^) replaced 
by a(c)) is due to Carneio (see Theorem 4.13). The proof presented here follows 



an idea of Ricardo Mane [3S] (see also |14| Theorem XI]) 



Proposition 5.23 (Property (3)). Afc 
static curves have energy equal to c{Lri). 



C £c 



{E{x,v) = c{Lrj)}, i.e., c 



M be a c semi-static curve, 
-,,c(L„)(7(0),7(r)). 



for each T > we have 



Proof. Let 7 : M - 

Al,+c{l,){i\[G.T]) 

Let us fix T > and A > 0, and consider a time-reparameterization of 7, given 
by 7a : [0,r/A] — > M, t !—> 'y{Xt). Observe that the end-points are not changed: 
7a (0) = 7(0) and 7a(T/A) = 7(T), but only the time lenght. Let us consider the 



^This (unintentional?) typographical "coincidence" honoring Ricardo Marie was first pointed 
out by Albert Fathi. 
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action of these curves as a function of A > 0: 

A{X) := Ai,+,(i„)(7A) - / ^ L,(7AW,7A(t))rfi + c(L,)T/A = 

Tl 

L.„{j{Xt),Xj{Xt))dt + ciL^)T/X. 

Since 7 is c semi-static (and therefore it is a c-time free minimizer for + c(L^)), 
then A has a minimum at A = 1. Therefore: 

= A'(1) = -T[L,{j{T),j{T))+c{L^)T] + 

^(7(i), i{t)m)t + ^(7(0, m) [i{t) + ^7(0] j dt . 

Integrating by parts (observe that — (|^7 + f^7) and recaUing the defini- 
tion of the energy E{x, v) — ^(x, v)v — L{x,v) and the fact that is preserved along 
the orbit {E{-t{t),^{t)) = £'(7(0), 7(0)) for all t e M), we obtain: 

= ^'(1) = ...= 

= -T [L,(7(r), 7(T)) + c{L,)] + L,(7(i), 7(0) 

-L(7(t),7(t)) + |J;(7W,7(t))7(i)) dt = 

= -TciL,)+ [ E{-f{t),^{t))dt^ 
Jo 

= [i?(7(0),7(0))-c(L,)]T. 

Hence, i;(7(0), 7(0)) = c(L,,). □ 

Let us now prove that Mane critical value coincides with Mather's a-function. 
We shall follow the proof given in [14, Theorem II] 

Proposition 5.24 (Property (4)). c(L^) — a{c), where c— [rj]. 

Proof. Suppose that fi is an invariant ergodic probability measure. If we fix a 
generic point (x, v) in the support of /i, it follows from the ergodic theorem that 
there exists a sequence of times r„ — > +00 such that {x, v) — > (a;, v) as r„ 
+00 and 

1 Z"^" 

Lr,d^= lim — / L^($f (x,'y))di. 



For the sake of simplifying the notation, let us denote {xt,vt) :— ^f'{x,v). Let 
B := max{|L^(a;, w)| : \\v\\ < 1} and for each n denote by tT„ : [0, xt„)] — > M 
the geodesic joining x to xt„ and by 7„ : [0, T„] — > M the projection of the orbit 
{i.e., 7„(t) — xt). We have: 

;^^L„+fc(7n * cr„) = 



n— >oo 



= lim — yli„ + fe(7„) + 7^ / i„(fTn(i),c^n(0) +^0^^ < 

= < lim (^AL^+kiin) + 7^{B + fc)diam(M) ) < 
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Therefore, if fc < — A^,, (/i) then ^k{x,x) — —oo. Hence, k < c{L,-i). It follows 
that: 

c(L^) > sup{-Ai,,(/x), AiG97l„.g(L)}> 

> -inf{AiJ^), /^eOT(i)} = a(c). 

Now we want to prove the reversed inequality. Let k < c{Lrj) and x,y £ M. 
Since <i>fe(a;,?/) = — oo, there exists a sequence of absolutely continuous curves 7„ : 
[0,r„] — > M such that 7„(0) = x, -jniTn) = y {i.e., 7„ G CT^{x,y)) and 

lim Al ,k{ln) = -oo. 

n— f oo 

Moreover, since L is bounded from below, we have that r„ — > +00. Let now yn be 
a Tonelli minimizer in CT„ix,y). Then, consider the invariant probability measure 
evenly distributed along 7„. The family of these measures is pre-compact and 
we can extract a subsequence converging (in the weak* topology) to an invariant 
probability measure fi. In particular, 

+ k= lim T^AL^+khn)- 

But since T„ > and lim„^oo ^L^+fc(7n) = ^kix,y) = -00, then Al^(^) + fc < 0. 
Therefore, for any k < c{L^) we can find an invariant probability measure /i such 
that fc < — Therefore: 

c{L^) < sup{-Ai„(^), AieOT„.g(L)}> 

< -inf{AijM), ^eOT(L)} = a(c). 

□ 

We shall provide two other alternative proofs of the above proposition. The first 
one uses the fact that the Mather set is included into the Marie set (but observe 
that in our proof of this fact - Proposition 5.26 - we use that a{c) — c{Lri)). The 
second one is shorter but it requires the use of holonomic measures (see Addendum 
4C). See also [14, Theorem II] for another proof. 

Alternative Proof I. Since Mc is compact (it follows from (3)) and invariant 
under the Euler-Lagrange flow then there exists an invariant ergodic proba- 
bility measure /i supported in it (KrylofF and Bogoliouboff [31], compare also with 
Proposition |4. 1 [ ) . If we fix a generic point (x, v) in the support of it follows from 
the ergodic theorem that there exists a sequence of times T„ — >■ +00 such that 
(x, v) — (x, v) as T„ — >■ +00 and 

1 Z"^" 

Lrid^i^ lim — / Lr^{^^{x,v))dt. 

In Jo 

Then, using the definition of a{c) and the fact that orbits in the support of this 
measure are semi-static, we obtain: 

-a(c) < [L,jd^i= lim / L^{^f{x,v))dt = 

J In Jo 



1 



= iirn — L4^t{x,v)) + c{L^)dt-c{L,,) = 

In Jo 

lim ^ = c(L^) = -c{Lrj) , 

n-S-+oo J_n 

where in the last equality we used that 4'ri,c(L^) is bounded on M x M (being 
Lipschitz on a compact manifold). Therefore a{c) > c{Lri). 



50 



ALFONSO SORRENTINO 



For the reversed inequality, we shall use the following version of the Ergodic theorem 
(see for instance |34| Lemma 2.1] for a proof). 

Lemma 5.25. Let {X,d) be a complete metric space and (X,B,i>) a probability 
space. Let f be an ergodic measure preserving map and F : X — > M a v-integrable 
function. Then, for v-almost every x € X the following property holds: 



Ve>0 3N>0: d{f'^ {x),x) < e and 



N-l „ 

Y,F{f={x))~N / Fdv 



< e. 



Let us now see how to use this lemma for our purposes. Let fi he a, c-action 
minimizing ergodic measure, i.e., 

{Lri{x, v) + a{c)) dfi — 0. 

Applying the above Lemma with F = L^ + a{c) and X = TM, we obtain that there 
exists a /i-fuU measure set A such that if (x, v) G A, then there exists a sequence 
Tn — > +00 such that 

d((x,v),$^Ja;,w)) "^°"0 and / (L($^(x, v)) + a(c)) . 

Jo 

Then: 

0>,,Q(c)(2;,7r($f (x, u))) + 0,,,a(c)(7r($i (x,w)),a;) = 

= Jun (0^_„(,)(a;,7r($f(a;,w))) + 0^,„(,)(7r($f(x,u)),7r($|^^(x,i;)))) < 

< lim / (L„{^f{x,v))+a{c)) dt = 0. 



It follows from the second property in Proposition 5.9 (5) that a(c) < c{L^) and 
this concludes the proof. □ 

Alternative Proof II. Let 7 be any closed curve and let /i^ be the probability 
measure evenly distributed on it (see Addendum 4C). Let k > c{Lri). It follows 
from the definition of c(L^) that AL^+kit^^y) > and therefore ^^^(/i^) > —k. It 
follows from the definition of holonomic measure then, that for any fj, holonomic 
probability measure, we have ^x,,, ifJ-) ^ ~k. Taking the infimum over all holonomic 
measure and using the result mentioned in iv) in Addendum 4C, we can conclude 
that —a{c) > —k. Since this holds for all k > c(L^), we obtain: a(c) < c{Lri). 
To prove the reversed inequality, observe that if fc < c{Lri), then there exists 7 
closed curve such that Al +k{l) < 0. Therefore, if /i^ is the associated holonomic 
measure we obtain: 

-a{c) < Ai^(7) < -k. 
Since this holds for all k < c{Lri), we conclude that a(c) > c{Lrj). □ 

The proof of Property (1) is essentially similar to the (first) proof of Proposition 



5.24 We shall prove this more general result, due to Ricardo Mafic [35J (see also 
[UrTheorem IV]). 

Proposition 5.26 (Property (1)). G 9Jt(L) is c-action minimizing if and only if 
supp/i C Ac. In particular, Mc ^ -Re- 
proof. Since Ac is closed, it is sufficent to prove the results only for the ergodic 
measures. ^ 

[«^=] Let jjL E S[Jl(L) be ergodic and suppose that supp/i C Ac. Applying the 
ergodic theorem, we know that for a /i-generic point (x, v) in the support of /i, there 
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exists a sequence of times T„ — > +00 such that — ^ {x,v) as T„ — )• +00 
and ^ 

L^dfi^ Urn / L^{<^f{x,v))dt. 

Then, using the fact that orbits in the support of this measure are semi-static and 
that q(c) — c(Lri), we obtain: 

Lrf + a{c)dfi = / L,-i + c{Ln) dfi = 



= lim ^ I L^{^f{x,v))+c{L^)dt = 
j.^ -0r,,c(Lo(7r($j^^(x,i;)),a;) ^ ^ 

n— >-+oo T„ ' 

where in the last equality we used that 4'ri,c{Ln) bounded on M x M (being Lips- 
chitz on a compact manifold). Therefore J Ljjdfi < — q;(c) and from the definition 
of a(c), it follows that J Lj^d^ = — a(c), i.e., is c-action minimizing. 

[=>] We shall use the above mentioned version of the ergodic theorem (see 
Lemma 5.25 1. 

Let /i be a c-action minimizing ergodic measure, i.e., 

{Lri{x, v) + a{c)) d/i ~ 0. 

Applying the above Lemma with F = Ljj + a{c) and X = TM , we obtain that there 
exists a /i-fuU measure set A such that if (x, v) G A, then there exists a sequence 
T„ — > -|-oo such that 

d((x,w),$^Ja;,w)) "^°°0 and / (L($^(a;, w)) + a(c)) . 



Then, let a > and recall that a{c) = c{L^): 

0,,x(Lj(a;,7r($^(a;,u))) + 0r,,c(L,)(7r($^(x,u)),a;) = 

< lim / {LJ^i{x,v))+c{LS) dt = 

n-»oo Jo 

< lim / (L„($['(a;,w)) +a(c)) = 0. 

Recalling property (5) in Proposition |5.9[ we can conclude that for any a > 0: 

0^,c(L„)(a^, 7r(*a (a^- ^^))) + </'^,c(L„)(^(*a (a^- v)) , x) = 

and therefore the orbit through the point {x, v) is c-static. Since the points for 
which this reasoning can be applied are dense in the support of and Ac is closed, 
then we prove the claim: supp/x C Ac. D 

Remark 5.27. Looking at the proof of Proposition |5 . 26 1 it is quite easy to see that 
we actually proved that: if /i € 9Jt(L) is such that supp/x C A/'c, then ^ is c-action 
minimizing (check that the same proof still works in this case). In fact, one can 
prove this stronger version: 

Proposition 5.28. /i e 9Jt(L) is c-action minimizing if and only if swpp fi C A/'c. 

We shall deduce such a proposition from the fact (to be proved later in Section 
|6] Proposition 6.33) that the ^'non-wandering sef of the Mane' set is contained in 
the Aubry set (see also [141 Theorem V.c]). 
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It is also quite easy to check that orbits in the Mane (resp. Aubry) set are 
asymptotic to the Mather set. 

Proposition 5.29. 1/7 : M — > M is a c semi-static curve, then 

liminid{-f{t),Mc) = 0. 
t— f ±00 

Proof. Let T > 1 and consider the probabiHty measure fiT evenly distributed 
along the piece of curve {{j{t),'y{t)) : t E [0,T]} (for a definition, for instance, the 
reader may check the proof of Proposition |4.1[ ) . The Lagrangian actions of these 
measures are equi-bounded (we use here that the orbit is semi-static): 

A f \ r T ( -(.WM '?^'),c(L„)(7(0),7(r)) 
^L^if^T) = X Jo ^''wW'^W)'^^ = c(L^) < 

< max (f>jj.ciL^){x, y) - c(L,,) < 00 . 

Therefore, this family of measures is pre-compact with respect to the weak* topol- 
ogy. Let us consider any converging subsequence /i^^ /i, with — > +00. Then, 
/X is invariant (see, again, the proof of Proposition |4.1[ ) and: 

L^d^ = lim f L,jdfik = lim '^''■^(-^i) -^''^^ — ^ _ c{L^) = 

= -c{Ln) ^ -a{c). 
Therefore, /i is c-action minimizing. □ 

Finally, we prove the most important result of this theory: the graph property 
of the Mather and Aubry sets, respectively. Property (5) and (6) in the diagram 
(see also Theorem 4.121. Because of the inclusion proved in Proposition 5.26 it is 
sufficient to prove it for the Aubry set. 

Theorem 5.30 (Mather's graph theorem, f42]). (Property (6)) 7r\Ac is an 
injective mapping of Ac into M, and its inverse {Tr\Ac)^^ : Ac — > Ac is Lipschitz. 

The proof of this theorem will be based on the following "crossing" Lemma, 
proved by Mather in |42] (to which we refer the reader for a complete proof). 

Lemma 5.31 (Mather's crossing lemma, j42]). Let K > 0. There exist e, (5, > 
0, C > such that if a,/3 : [— £,e] — > M are solutions of the Euler-Lagrange 
equation with ||(q!(0), q;(0))|| < K, ||(/3(0), /3(0))|| < K and 

d(a(0),;3(0)) < (5 and d ((a(0), a(0)), (/3(0), ;3(0))) > Cd(a(0), /3(0)), 

then there exist curves a, b : [— e, e] — > M with end-points a(—e) — a(— e), a{e) — 
P{e) and b{~e) — /3(— e), b{e) = a{e) such that: 

2 



Al, (a) + Al^ (/3) - Al^ (a) - A^^ ib)>dd ((a(0), d(0)), (/3(0), /3(0)) 



> 0. 
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Proof. [Theorem 5.30 We shall first use Lemma 5.31 to prove the Lipschitz 
property and then the rest will be just a consequence of this property. Let choose 
K := max^ (this is finite since Ac is compact) and let e,6,'d,C he as in 

Lemma 



5.31 



Then, we shall prove that: if (xi, Wi), (a;2, ^2) G Ac are such that 
d{xi,X2) < S, then d {{xi,vi), {x2, V2)) < Cd{xi,X2)- 

Suppose by contradiction that d ((xi, wi), (2:2, ^2)) > Cd{xi, X2) and consider the 
flow lines through these points, namely a{t) := $f and /3(t) := ^f'{x2,V2)- 

They satisfy the hypothesis of Lemma 5.31 (with our choice of K) and hence we 
can deduce the existence of two other curves a, b : [— e, e] — > M with end-points 

a(— e) — a{—e), a{e) — /3{e) and b{—e) = /3(— e), 6(e) = a{e), such that: 

AL^ia)+AL^{b)<ALja) + AL^i/3). 

But then: 

'/'»,x(L,)(a(-e),a(e)) + (/'^,c(L„)(K-£)>^(£)) < 
< Al^ (a) + (6) < Ai„ (a) + A^^ (/3) = 
= -0^,c(L,)(a(£),a(-e)) - <j)^,c{L„)Wie), ^i-e)) . 

where in the last equality we used that a and /? are c-semistatic. The above 
inequality and the triangle inequality for 4>n.c(L,,) (see Proposition 5.9 (1)) lead 
to a contradiction to Proposition 5.9 (5): 

07,x(Lj ("(-£), /3(e)) = 0,,,c(Lj(a(-e),a(£)) < 

< - (0,,x(Lj(&(-e),6(£)) +0r,x(L,)(a(£),a(-e)) +0,,,c(L„)(/?(e),/3(-e))) = 
= - (0,,x(Lj(/3(~£),a(£)) + 0,,,c(L,)(a(£),a(-£)) + 0r,x(L,)(/3(£),/3(-£))) < 

< -Kc(L,) (/?(-£), a(-£)) + 0„,,(L,) (/?(£), /?(-£))) < 

< -0,,x(Lj(/3(£), "(-£)) ■ 

Therefore the inverse of the projection is locally Lipschitz and this concludes the 
proof. □ 

Remark 5.32. (i) Actually it follows from the proof (in the choice of K) that 
the graphs of the Aubry sets (or Mather sets) corresponding to compact sets of 
cohomology classes, are equi-Lipschitz. 

{it} An alternative proof of the graph property will be presented in Section [6j 
following Fathi's weak KAM theory. 

One can show several other properties of these sets. For instance, we have 
remarked that the Mather sets, being the support of invariant probability measures, 
are recurrent under the flow. This is not true anymore for the Aubry and Mane sets, 
but something can still be said. Let us flrst recall the deflnition of e-pseudo orbit. 
Given a (compact) metric space X and a flow cp on it, we say that there exists an e- 
pseudo orbit between two points x,y € X, if we can find {xn}n=o positive 
times ti,. . . ,tk^ > such that xq = x, x^^ = y and dist(^(pt.^-^ (xi) ,Xi^ij < e for 
all z = 0, . . . , k^. 

Proposition 5.33. (i) $^|A''c is chain transitive, i.e., for each e > and for all 

{x,v), {y,w) G Afc, there exists an e-pseudo-orbit for the flow <i>^ connecting them. 
(ii) $^|ylc is chain recurrent, i.e., for each e > and for all {x,v) £ Ac, there 
exists an e-pseudo-orbit for the flow $^ connecting {x,y) to itself. 

The proof of this result can be found for instance in [14, Theorem V] 



As a consequence of the chain-transitivity it follows that the Mane set must be 
connected (the Aubry set in general not). 
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Corollary 5.34. The Mane set is connected 



ADDENDA 



5. A - Some topological and symplectic properties of these sets 



In this Addendum we want to discuss (without any proof) some topological and 
symplectic properties of the Aubry and Maiie sets, similar to what we have ahead 
seen and proved for the Mather sets. 

In Section |5] Proposition |4.27| we had related the intersection of Mather sets 
corresponding to different cohomology classes, to the "flatness" of the a function. 
The same result holds for the Aubry set and has been proved by Daniel Massart 
in inZl Proposition 6]. However, the proof in this case is less straightforward and 
more involved. 



Proposition 5.35 (Massart, f37]). Let c e II^(il/;M) and denote by Fc maximal 
face of the epigraph of a containing c in its interior. 

(i) // a cohomology class c\ belongs Fc, then Ac C Ac-^ ■ In particular, if c\ belongs 
to the interior of Fc, then they coincide, i.e., Ac = Ac^. 

(ii) Conversely, if two cohomology classes c and c\ are such that Ac^Ac^ 7^ 0, then 
for each X € [0, 1] we have a{c) = a(Ac + (1 — A)ci), i.e., the epigraph of a has a 
face containing c and ci . 

In particular, Massart proved that it is possible to relate the dimension of a "face" 
of the epigragph of the a-function to the topological complexity of the Aubry sets 
corresponding to cohomologies in that face (see |37l Theorem 1]). More precisely, for 
any sufficiently small e > 0, let us define Cc{s) be the set of integer homology classes 
which are represented by a piecewise closed curve made with arcs contained in 
Ac except for a remainder of total length less than e. Let Cc ■= C\s>o C'c(e)- Let 
Vc be the space spanned in Hi(M; E) by Cc. Note that Vc is an integer subspace of 
Hi (M; K), that is it has a basis of integer elements (images in Hi (M; K) of elements 
in Hi(M;Z)). 

We denote by: 

- Fc the maximal face (flat piece) of the epigraph of a, containing c in its interior; 

- Vect Fc the underlying vector space of the afhne subspace generated by Fc in 
H\M;Ry, 

- the vector space of cohomology classes of C^ 1- forms that vanish on Vc, 

- Gc the vector space of cohomology classes of C^ 1-forms that vanish in T^jM for 
each X G Ac', 

- Ec the space of cohomology classes of 1-forms of class C^, the supports of which 
are disjoint from Ac. 



Theorem 5.36 (Massart, 137]). Ec C VectF^ C C V/. 



Moreover, as we have already proved for the Mather sets (see Addendum 4A, 
Proposition 4.331, also these sets are symplectic invariant. The same holds also for 
these other sets, but the proof in this case is definitely less trivial and requires a 
more subtle study of these action-minimizing orbits. It can be deduced, for instance, 
as a special case of |H1 Theorem 1.10] (which also applies to the non- autonomous 
case) . Let us denote by A*c (H) and Af* (H) the Aubry and Mane sets associated to a 
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Tonelli Hamiltonian H (in the sense of the Legendre transform of the corresponding 
ones for the associated Lagrangian). Then: 

Theorem 5.37 (Bernard, [S]). Let L : TAf — > M. he a Tonelli Lagrangian and 
H : T*M — > K the associated Hamiltonian. If ^ : T* M — > T*A/ is an exact 
symplectomorphism, then 

Al{H o <^>) = {A*{H)) and {H o <P) ^ <^>-'' {U* {H)) . 

This result can be easily extended to non-exact symplectomorphisms, using 
Lemma 4.30 (as we have already done in the case of Proposition 4.31 1. 

Theorem 5.38. Let L : TM — > R be a Tonelli Lagrangian and H : T* M — >R 

the associated Hamiltonian. If : T*Af — > T*Af is a symplectomorphism of class 
then 

A:{Ho^) = VI/-1 (^:+[>,](i7)) and AC(i? o = vf-i (AC+[*](i/) 

Remark 5.39. More geometric proofs of this result can be obtained using weak 
KAM theory, for instance |54| Lemma 1] (it does not apply to all symplectomor- 
phism, but only to those that are Hamiltonianly isotopic to the identity) and |12| . 
See also [50j . 



5.B - An example: the simple pendulum II 

In Addendum 4.B we discussed the Mather sets, the a-function and the /3- 
function, in the case of the special case of a simple pendulum, described by the 
Lagrangian: 

L-.TT — > E 
{x,v) I — > + (1 cos(27rx)). 

In particular we proved that: 

. Forall-f <c< f,7W, = {(0,0)}; 
• if c> ^, 

M±c = {{x,v) : V = ±\/2[(l + a{c)) - cos(27rx)], Vx G T}. 

We want to see which are the Mane and Aubry sets in this case. Let us start 
recalling the following fact, that we have proved, in a slightly different form, in 
Section [S] 

Proposition 5.40. Let A be a c-invariant (Lipschitz) Lagrangian graph in T*Af. 
Then, the projection on TM of each orbit on K is c semi-static. 



See for instance [21]. The proof is essentially the same as Proposition 3.8 (see 



also Remarks 3.9 (ii) and 5.14 {Hi)). The proof extends to the case of Lipschitz 
c-Lagrangian graphs (i.e., Lipschitz sections that are locally the graph of closed 
1-forms of cohomology class c) . Observe in fact that also in the Lipschitz case, the 
Hamiltonian keeps constant on invariant Lagrangian graphs (see for instance |54|V 

that for c > -, 



Hence, it follows from Proposition 



5.40 



A/'ic 2 {{x,v) : V = ±\/2[{l + a(±c)) - cos(27ra;)], Va; e T} ^ M±c. 

In fact, it is easy to check that {(x, v) : v = ±a/2[(1 -|- a{c)) — cos(27ra;)], Va; € T} 
is the graph of a closed 1-form of cohomology class ±c (the cohomology is just the 
signed area enclosed between this graph and the x-axis). See also the discussion in 
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Addendum 4.B. _ 

Moreover, N±c must be equal to M.±c, since it is connected (Corollary 5.341 and it 

must be contained in the energy level corresponding to the value a(±c). Therefore, 

recalling the inclusions in Theorem |5.21[ we can conclude that 

_ _ ~ 4 
N±c = A±c = M±c for all c > -. 

Let us see what happens for |c| < Observe that they all correspond to the 
same energy level, namely the one of the separatrices (a(c) = in this case). In 
this energy level there are exactly three orbits: 

- The fixed point (0,0), i.e., 7o(i) = 0. 

- The upper separatrix 7+; for instance let us choose the parametrization 
given by 

7+(t) = 7r($f(l/2,2)). 

- The lower separatrix 7^; for instance let us choose the parametrization 
given by 

7-(t) = 7r($f(l/2,-2)). 

Observe that because of the symmetry of L and the chosen parametriza- 
tions, we have that 7+(t) = 7_(— t) for all t e M. 

First of all, let us show that for |c| < ^, neither 7+ or 7_ can be c semi- 
static. In fact, let us consider a |c|-closed 1-form r^c whose graph is contained in 
the region between the separatrices . This is possible since c is less than A/n and 
the cohomology represents the signed area of the region between the curve and the 
X-axis. Moreover, since |c| is strictly less that 4/7r, there will be a positive measure 
subset of T on which H{x, ric{x)) < 0. 

If 7_|_ were c-semistatic (similarly for 7_), then using that 7+ is asymptotic in the 
past and in the future to 0, that a(c) — and that the Mane potential (prj^fl is 
Lipschitz continuous (Proposition 5.9 (3)), we obtain: 

0„..o(O,O) = hm 0„^^o(7+(-T),7+(7^)) = 

I — > + oo 

lim / L^^{j+{t),j+{t))dt^ 



lim / {vcil+{t)) ■ j+{t) - H{j+{t),ij,{j+{t)))) dt 



T 
T 



-Jim / i7(7+(t),r;,(7+(t)))di>0 



> 



where the third inequality comes from Fenchel-Legendre inequality and the last one 
from the fact that there exists a positive measure set of T in which -ff (7+ (i) , ?7c(7+ (0)) 
is strictly negative. But this leads to a contradiction, since the action of the con- 
stant path 7o is zero: A^^^ (70) = 0. 
We have just proved that (use also Theorem 5.21 1: 

Nc = Ac = Mc = {(0, 0)} for all |c| < ^ . 

TT 

Finally, let us consider the case c± :— ±-. As above, it follows from Proposition 



5.40 (taking the graphs of the separatrices as invariant Lipschitz Lagrangian graphs) 



that: 

Uc± = {{x,v) : V = ±x/2[F^cos(2^, Va; e T} D Mc±- 

We want to show that also in this case Ac± = Nc± (but observe that this time they 
contain the Mather set properly). Let us denote by rj± the closed 1-forms given 
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by the graphs of (respectively) the upper and lower separatrix. We have already 
pointed out that [77^] = c±. The key observation is the following lemma. 

Lemma 5.41. For every x,y CzT we have (f)ri_^_o{x,y) — —4>ri_fl{y,x). 

Observe that it follows immediately from this Lemma that the upper (resp. 
lower) separatrix is not only c+ semi-static (resp. c_ semi-static), but it is indeed 
c+ static (resp. c_ static). Therefore, Afc± =-^c±- 



Proof. The above equality is always true ifx = y (see Proposition 5.9 (4)). Suppose 
without any loss of generality that x < y and let S' < T such that 7+(>5') — x = 
7_(— 5) and j+{T) ~ y ^ 7_(— T) (this is true only for the parametrization that 
we chose above). Now, using that these curves are semi-static (for their respective 
cohomologies) , the symmetry of L, the relation between 7+ and 7_ and the fact 
that ?7_|_ = — 77_, we obtain: 

Js 

T 



(i(7-(-t),-7-(-t)) +^-(7-W) • (-7- (-*))) dt 

-s 

(i(7_(s),7-(s)) - ry_(7_(s)) • ^_{s)) dt = 

■T 

-(l>r,^fi{y,x) . 



Summarising: 

• For c> i: 

A/±c = A±c = M±c = ±v/2[(l + a(c)) -cos(27rx)], G T} . 

• For |c| < f : ^ 

Af,^Ac^M,^{{0,0)}. 

• For c± ~ ±-: 

K± =A± ={{x,v): i; = ±v/2[l-cos(2^a;)], VxeTjDMc^ -{(0,0)}. 



□ 



Remark 5.42. (z) For c± = ±- we have examples in which the Mather set is 
strictly contained in the Aubry and Mane sets. 

(ii) In all the above examples, the Aubry set coincides with the Mane set. However 
it is possible to find examples in which this is not anymore true. For instance, 
consider the double covering 2T of T and let p : 2T — !• T be the covering map. Let 
us lift the Lagrangian of the simple pendulum to a Lagrangian L on T(2T), given 
by L{x,v) ~ L{p{x),v). Observe that one can equivalently consider the system on 
TT given by i(x, v) — — (cos(47rx) — l). One can verify that (we specify the 
dependence on the Lagrangian and consider the projected sets): 

. Xo(£) = (Xo(i)) = p-' ({0}) = {0, 1/2}. 

. A^Cl) = p-i {Ao{L)) = p-i ({0}) = {0, 1/2}. 
This result is true in general when we consider a finite covering (see fl7', Lemma 
2.3]). However, the same is not true anymore for the Mane set. In fact, one can 
check that the four separatrices connecting the two minimizing fixed points are all 
0-semistatic and therefore: 

AAo(i) = 2TD{0,i} = p-i(AAo(L)). 
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Figure 3. The two invariant Lagrangian graphs Ai (continuous 
line) and A2 (dashed Hne) for the "Hfted" pendulum on 2T. 

In fact, it is easy to verify that the lifted system has two exact invariant Lagrangian 
graphs (zero-cohomology = zero area) made by the lifts of the separatrices (com- 
bined so to enclose zero area). Therefore, the lifts of the separatrices are semi- 
static (since they are contained on 0-Lagrangian graphs), but they are not 0-static 
(see figure 3). 



5.C - Mather's approach: Peierls' Barrier 

In this addendum we want to describe Mather' original approach to the study of 
action-minimizing curves. As far as the definition of the Mane set is concerned, it 
is pretty much the same as the one we have described before. The main difference 
is in the definition of the Aubry set. In fact, Mather's original definition considered 
what he called c-regular-minimizers. We shall see that they indeed coincide with 
c-static curves. 

The main ingredient in Mather's approach is the notion of Peierls Barrier, in- 
troduced in [4|i 1^ 

For t > and x, y € M, let us consider : 

(24) hrj.t{x,y) ^ min L,j{-f{s),j{s)) ds , 

Jo 

where the minimum is taken over all piecewise paths 7 : [0, t] — > M, such 
that 7(0) = X and j(t) = y. This minimum is achieved because of Tonelli theorem 



(Theorem 5.1 1. We define the Peierls barrier as: 



(25) h„{x, y) = liminf (/i„^t(a;, y) + a{c)t) . 

t— f +00 

Remark 5.43. (i) Observe that h,^ does not depend only on the cohomology class 
c, but also on the choice of the representative 77; namely, if 77' = rj + df, then 
hri'{x,y) = hri{x,y) + f{y) — f{x). Anyhow, this dependence will not be harmful 
for what we are going to do in the following (it will not change the set of action- 
minimizing curves). 

(ii) The main difference between Peierls barrier and Mane potential is that in this 



■^The function that we are defining here is a actually a sUght generalization of /i^ defined in 
|44l . Pay attention that throughout this article, the sign of the a function is wrong: wherever 
there is a(c), it should be substituted by —a{c). 
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case we consider curves defined over longer and longer time intervals. In particular, 
it is easy to check that: 

(Hi) This function /i^ is a generalization of Peierls Barrier introduced by Aubry 
[3] and Mather |39} |4T| |43] in their study of twist maps. In some sense we are 
comparing, in the limit, the action of Tonelli minimizers of time length T with the 
corresponding average c-minimimal action — a(c)T. Remember, in fact, that -~a{c) 
is the "average action" of a c-minimal measure. 

(iv) Albert Fathi [22J showed that - in the autonomous case - this liminf can 
be replaced with a lim. This is not generally true in the non- autonomous time- 
periodic case (see for instance |25| for some counterexamples); Tonelli Lagrangians 
for which this convergence result holds are called regular. Patrick Bernard 15] 
showed that under suitable assumptions on the Mather set it is possible to prove 
that the Lagrangian is regular. For instance, if the Mather set A4c is union of 1- 
periodic orbits, then is regular. This problem turned out to be strictly related to 
the convergence of the so-called Lax-Oleinik semigroup (see |22| for its definition). 

Analogously to Proposition |5.9| one can prove the following. 

Proposition 5.44. The values of the map h^i are finite. Moreover, the following 
properties hold: 

i) for each x, y, z € M and t > 

hrj{x, y) < hrjix, z) + hri^t{z, y) + a{c)t; 

ii) for each x,y,z G M , hjj{x, y) < hrj{x, z) + hri{z, y). 

iii) for each x,y,z £ M, h^{x,y) < hjj{x,z) + (j)^.o,(c){z,y)- 

iv) for each x, y, z £ M and t > 

hrjix, y) < hrj{x, z) 4- /i,,^t(z, y) + a{c)t] 

v) for each x G M, hr^{x,x) > 0; 

vi) for each x,y <E M, hr,{x,y) -\- h,j{y,x) > 0. 

It is interesting to consider the following symmetrization: 

Sc : M X M — > R 
(26) {x,y) I — > h,j{x,y) + h,j{y,x). 

Observe that this function does now depend only on the cohomology class c and 
moreover it is non-negative, symmetric and satisfies the triangle inequality. 
An interesting property of Sc is the following (see |44l Section 8] ) . If c? denotes the 
distance induced on M by the Riemannian metric g, then there exists C > such 
that for each x,y G M we have 

S,{x,y)<Cdix,y)\ 

Remark 5.45. The same estimate continues to be true for the non- autonomous 
time-periodic case. In this case we have that 

S.iix, To), (y, Ti)) < C[d{x, y) + \\t^ - tqH]^ 

for each (x,tq), (y,Ti) G Ac, where 

||ti - Toll = inf {|<i - tol : U e M, t, = n (mod. 1), i = 0, 1} . 

Let us see now some relation between this Peierls barrier (or equivalently 5c) 
and c-action minimizing curves. Let 7 : M — > M be a c-minimizer and consider 
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in the a-limit setj^of 7 and Xi^,a;^ in the cj-hniit sei|^ of 7. John Mather 
in |44l Section 6] proved that 5c{xa,x'^) — 5c{xunx'^) = 0. In general, it is not 
true that 5c{xonXiS)=Q\ what one can prove is that this value does not depend on 
the particular x^ and x^^, i.e., 5c{Xa,XiS) = 5c{x'a,x'^): it is a property of the 
limit sets rather than of their elements. Nevertheless, there will exist particular 
c-minimizers for which this value is equal to and these will be the c-minimizers 
that we want to single out. 

Definition 5.46 (c- regular minimizers). A c-minimizer 7 : M — > M is called 
a c-regular minimizer, if 5c{xa,Xi^) = for each x^ in the a-limit set of j and x^j 
in the Lu-limit set of ^. 

Mather defined the Auhry set as the union of the support of all these c-regular 
minimizers. 

Definition 5.47 (Aubry set). The Auhry set (with cohomology class c) is: 

Ac = {{l{t)Ti{t)) ■ 'y is a c-regular minimizer andt G M} . 

it turns out that this set coincides exactly with the one that we have defined in 
Section [5] In fact, one ca prove that: 

Proposition 5.48. 7 is a c-regular minimizer of L if and only if j is a c-static 
curve of L. 

A proof of this can be found in [22, Proposition 9.2.5]. The essential ingredient 



is that (t>T],a{c)ix,y) = hri{x,y) if x,y £ Ac (see also Remark 6.281 



Moreover, one can also provide another alternative definition of the (projected) 
Aubry set: 

Proposition 5.49 (See |221 Proposition 5.3.8]). The following properties are equiv- 
alent. 

i) X e Ac; 

ii) h,f{x, x) = 0; 

iii) there exists a sequence of absolutely continuous curves 7„ : [0, i„] M 
such that: 

- for each n, we have 7n(0) — "/n{tn) — x; 

- the sequence t„ — +00, as n ^ +00; 

- as n -J> +00, /p" L^(7„(s),7„(s)) ds -\- a{c)t„ -> 0. 

Remark 5.50. (i) Therefore, the Aubry set consists of points that are contained in 
loops with period as long as we want and action as close as we want to the minimal 
average one. 



(ii) Moreover, it follows from ii) in Proposition 5.49 that 5c is a pseudometric on 
the projected Aubry set 

Ac = {x e M : Scix,x) = 0}. 

(iii) One can easily construct a metric space out of (Ac, Sc). We call quotient Aubry 
set the metric space {Ac, Sc) obtained by identifying two points in Ac, if their Sc- 
pseudodistance is zero. This set plays quite an interesting role in the study of the 
dynamics; see for example ^51 ITfl [551 [25] for more details. 



^ Recall that a point z is in the a-limit set of 7, if there exists a sequence t„ — > —00 such that 
7(t„) 2. 

^ Recall that a point z is in the a;-limit set of 7, if there exists a sequence in — > -|-oo such that 
7(t„) -5> z. 
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6. Weak KAM theory 

Another interesting approach to the study of these invariant sets is provided by 
the so-called weak KAM theory, which represents the functional analytical coun- 
terpart of the variational methods discussed in the previous sections. In section |3] 
in fact, we pointed out the relation between KAM tori (or more generally, invari- 
ant Lagrangian graphs) and classical solutions and subsolutions of Hamilton-Jacobi 



equation (see Remark 3.2 (iv)). This approach that we are going to describe, will be 
based on studying "weak" (non-classical) solutions of Hamilton-Jacobi equation and 
some special class of subsolutions (critical subsolutions). From a more geometrical 
point of view, this can be interpreted as the study of particular Lagrangian graphs 
(not necessarily invariant) and their non-removable intersection (see also [50 ). This 
point of view makes this approach particularly interesting, since it relates the dy- 
namics of the system to the geometry of the space and might potentially open the 
way to a "symplectic" definition of Aubry-Mather theory (see also Sections 4A, 5A 
and [ilSlIIl])- 

In this section we want to provide a brief presentation of this theory, omitting most 
of the proofs, for which we refer the reader to the excellent - and self-contained - 
presentation |22| . 

The main object of investigation is represented by Hamilton-Jacobi (H-J) equa- 
tion: 

H,i{x, d.j.u) = H{x, rjix) + d^u) = k , 

where is a closed 1-form on M with a certain cohomology class c. Observe that 
considering H-J equations for different 1-forms corresponding to different cohomol- 
ogy classes, is equivalent to Mather's idea of changing Lagrangian (see section |4]). 

From now on, we shall consider L to be a Tonelli Lagrangian on a compact 
manifold M and H its associated Hamiltonian. Let us fix 77 to be a closed 1-form 
on M with cohomology class c, and, as before, denote by and iJ^ the modified 
Lagrangian and Hamiltonian. In classical mechanics, one is interested in studying 
solutions of this equation, i.e., functions u : M — )■ M such that H^{x,dxu) = k. 
It is immediate to check that for any given cohomology class there exists at most 
one value of k for which these solutions may exist. In fact, it is enough to observe 
that if u and v are two functions on a compact manifold, there will exist a point 
Xq at which their differentials coincide (take any critical point of u ~ v). We shall 



see (Theorem 6.16 1 that this value of k for which solutions may exist, coincides 
with a{c) or Mane critical value c(L^) (defined in sections |4] and [5| . 

Remark 6.1. The existence of such solutions has significant implications to the 
dynamics of the system and it is, consequently, quite rare. In particular, they 
correspond to Lagrangian graphs, which are invariant under the Hamiltonian flow 
$^ (Hamilton-Jacobi theorem). For instance, in the case of M = T'* and nearly- 
integrable systems these solutions correspond to KAM tori (this might give an idea 
of their rareness). 

One of the main results of weak KAM theory is that, in the case of Tonelli 
Hamiltonians, a weaker kind of solutions do always exist. In the following we are 
going to define these generalized solutions and their relation with the dynamics of 
the system. It is important to point out that one of the main ingredient in the 
proof of all these results is provided by Fenchel inequality (cf. |3] in Section [2]) . 

Let us start by generalizing the concept of subsolution. In the C^-case it is easy 
to check - using Fenchel inequality - that the following property holds (the proof is 
essentially the same as for (|8| in Section [3|. 
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Proposition 6.2. Let u : Af — > M be ; u satisfies H{x,rj{x) + dxu) < k for all 
X G M if and only if for all a < b and 7 ; [a, 6] — > M 

u{-i{b)) ~ u[-i[a)) < ( L„{j{t),^{t))dt + k{b-a). 

J a 

This last inequality provides the ground for to a definition of subsolution in the 
C°-case. 

Definition 6.3 (Dominated functions). Let u : M M. be a continuous func- 
tion; u is dominated by i,, + k, and we shall write it -< i,, + k, if for all a < b and 
7 : [a, b] M 

(27) u(7(6)) - u(7(a)) < / L„{^{t),j{t)) dt + k{b ~ a). 

One can check that if u -< + fc then u is Lipschitz and its Lipschitz constant 
can be bounded by a constant C{k) independent of u; in fact, it is sufficient to 
apply the definition of dominated function with the speed-one geodesic connecting 
any two points x and y and consider the maximum of L over the unit tangent ball 
(see |22| Proposition 4.2.1 (iii)]). In particular, all dominated functions for values 
of A: in a compact set are equiLipschitz. On the other hand, it is easy to check that 
each Lipschitz function is dominated by -\- k, for a suitable k depending on its 
Lipschitz constant: this shows that dominated functions exist. 
Dominated functions generalize subsolutions of H-J to the continuous case. In fact: 

Proposition 6.4 (see Theorem 4.25]). If u ^ Ljj + k and d^u exists, then 
H{x,rj{x)-\-dxu) < k. Moreover, ifu : M — > M is Lipschitz and H{x,r]{x)+dxu) < k 
a.e., then u ^ L^j + k. 

Remark 6.5. Using the fact that any Lipschitz function is differentiable almost 
everywhere (Rademacher theorem), one could equivalently define subsolutions in 
the following way: a locally Lipschitz function u : M — > M is a subsolution of 
Hr,{x,dxu) — k, with fc G M, if H.^[x,dxu) < k for almost every x G M. 

Remark 6.6. One interesting question is: for which values of k do there exist 
functions dominated by + /c (or equivalently subsolutions of Li{x, r\(x) + dxU) = 
fc)? It is possible to show that there exists a value fee G M such that ii(x, rj+d^u) = k 
does not admit any subsolution for k < kc, while it has subsolutions for k > kc, see 
|32) [22]. In particular, if k > kc there exist C°° subsolutions. It turns out that the 
constant kc coincides with a(c) and the Mane's critical value (where c = [t]]). See 
[TS1I51]. 

Functions corresponding to this "critical domination" play an important role, 
since they encode significant information about the dynamics of the system. 

Definition 6.7 (Critical subsolutions). A function u ^ L,i + a{c) is said to 
be critically dominated. Equivalently, we shall also call it an rj-critical subsolution, 
since H{x,rj(x) + d^u) < a{c) for almost every x G M. 

Remark 6.8. The above observation provides a further definition of a{c): 
a(c) — inf max H ( X, ri(x) + dxu) . 

This theorem has been proven in [151 Theorem A] (see also in [22 J. This infimum is 
not a minimum, but it becomes a minimum over the set of Lipschitz functions on M 
(also over the smaller set of C^'^ functions, see the addendum at the end of this sec- 
tion and |26l I5]l. This characterization has the following geometric interpretation. 
If we consider the space T*M equipped with the canonical symplectic form, the 
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graph of the differential of a C-^ ?7-critical subsolution (plus the 1-form 77) is nothing 
else than a c-Lagrangian graph {i.e., a Lagrangian graph with cohomology class 
c). Therefore Mane c-critical energy level £* = {{x,p) € T*M : H{x,p) = a{c)} 
corresponds to a (2d — l)-dimensional hypersurface, such that the region it bounds 
is convex in each fiber and does not contain in its interior any c-Lagrangian graph, 
while any of its neighborhoods does. 

Analogously to what we have already seen for subsolutions, it would be interest- 
ing to investigate if there existed an equivalent characterization of classical solutions 
of Hamilton-Jacobi, that does not involve the regularity of the solution. This would 
allow us to define "weaAi" solutions, that hopefully are not so rare as the classical 
ones. 



Let us now recall some properties of classical solutions, which will allow us to 
provide a "weaker" definition of solution (the proof of this proposition is essentially 
the same as for ([s]) in Section [3|. 

Proposition 6.9 (see |22l Theorem 4.L10]). Let u : AI ^ R a function and 
fc G M. The following conditions are equivalent: 

(1) u is solution of H{x,rj[x) -\- dxu) — k; 

(2) u ^ + k and for each x € M there exists ■ (—00, -f-00) — ^ M such that 
7x(0) = X and for any [a, b]: 

uilx{b)) - u{^xia)) = / Ln{-fx{t),ix{t))dt + k{b-a). 

J a 

(3) u < + k and for each x Cz M there exists jx ■ {—oo, 0] — > M such that 
7x(0) — X and for any a < b < 0: 

u{jx{b)) - u{-fx{a)) = / L,j{jx{t),jx{t))dt + k{b- a). 

J a 

(4) u < + k and for each x (z M there exists jx ■ [0, +00) — M such that 
7x(0) = X and for any > a < b: 

u{jx{b)) - u{-fx{a)) ^ / Lr,{jx{t),jx{t))dt + k{b~ a). 



Inspired by this fact, let us consider the curves for which equality in (27 1 holds. 

Definition 6.10 (Calibrated curves). Let u ^ L,^ + k. A curve j : I ^ M is 
(u, Ljj, k)-calihrated if for any [a, 6] C / 



u{^{b)) - u{^{a)) = / L„(7(t),7(i))dt + fc(6-a). 

J a 

These curves are very special curves and it turns out that they are orbits of the 
Euler-Lagrange flow. In fact: 

Proposition 6.11. If u ^ L^ + k and 7 : [a, 6] M is (u, Lri,k)-calihrated, then 
^ is a c-Tonelli minimizer, i.e., 

L.^{j{t),j{t))dt< I L^{<j{t),&{t))dt 

J a 

for any a : [a,b] — >■ M such that cr(a) = 7(0) and a{b) = 7(6). Most of all, this 
implies that j is a solution of the Euler-Lagrange flow and therefore it is (if L 
is C). 
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The proof of this result is the same as the one of Proposition 3.8 (see also |22l 
Proposition 4.3.2 and Corollary 4.3.3]). 

Moreover, the following differentiability result holds. 

Proposition 6.12 (see [22] Theorem 4.3.8]). Let u -< L,, + fc and 7 : [a, 6] M 

be (u, L^i, k)-calibrated. 

i) If d^(t)U exists for some t G [a,b], then H('-/(t),r]('j{t)) + dj(^t)u) — k and 

dL 

d^{t)U = -^(7(i),7(i))- 

ii) If t Cz {a,b), then dj(^t^u exists. 

Remark 6.13. Calibrated curves are "Lagrangian gradient lines" of grad^u (where 

dL 

grad^^u is a multivalued vector field given by the equation d^u — (x,grad^it). 

Therefore, there is only one possibility for calibrated curves, at each point of dif- 
ferentiability of u. 

This suggests the following definitions. 

Definition 6.14 (weak KAM solutions). Let u < L,-i + k. 

• u is a weak KAM solution of negative type (or backward Weak KAM solu- 
tion) if for each x G M there exists 7x : (— cx),0] — >■ M such that 7^(0) = x 
and is [u, Lri,k) -calibrated; 

u u is a weak KAM solution of positive type ( or forward Weak KAM solution) 
if for each x d M there exists ■ [0; +00) — > M such that 7^(0) = x and 
jx is (u, Ln,k)-calibrated. 

Remark 6.15. Observe that any weak KAM solution of negative type u„ (resp. 
of positive type u^) for a given Lagrangian L, can be seen as a weak KAM solution 
of positive type (resp. of negative type) for the symmetrical Lagrangian L{x, v) := 
L(x, —v). 

Let us denote with the set of Weak KAM solutions of negative type and 5+ 
the ones of positive types. Albert Fathi |19l [22] proved that these sets are always 
non-empty. 

Theorem 6.16 (Weak KAM theorem). There is only one value of k for which 
weak KAM solutions of positive or negative type of H{x,ri(x) + dxu) ~ k exist. 
This value coincides with a(c), where a : iV-(M;M.) — > M is Mather's a-function. 
In particular, for any u ^ L^i -\- a{c) there exist a weak KAM solution of negative 
type and a weak KAM solution of positive type u^, such that = u = u+ on 
the projected Aubry set Ac. 

Therefore, for any given weak KAM solution of negative type u_ (resp. of 
positive type u+), there exists a weak KAM solution of positive type of positive 
type M+ (resp. of negative type u_) such that u_ = w+ on the projected Aubry set 
Ac. In particular: 

Proposition 6.17 (see [22] Theorem 4.12.6]). The projected Mather set Mc is 
the uniqueness set for weak KAM solutions of the same type. Namely, if U-,V- 
are weak KAM solutions of negative type (resp. u+,v+ are weak KAM solutions of 
positive type) and = u_ on Mc (resp. = w+ on Aic), then they coincide 
everywhere on M . 

Two solutions U- and u-\- that coincide on the (projected) Mather set are said 
to be conjugate. We shall denote by (u_,u+) a couple of conjugate subsolutions. 
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Let US try to understand the dynamical meaning of such solutions. Albert Fathi 
[22] - using these generahzed solutions - proved a weak version of Hamilton-Jacobi 
theorem, showing the relation between these weak solutions and the dynamics of 
the associated Hamiltonian system. We shall state it for weak KAM solution of 
negative type, but - using remark [6.15| - one can deduce an analogous statement for 
weak KAM solutions of positive type. 

Theorem 6.18 (Weak Hamilton-Jacobi Theorem, f22l Theorem 4.13.2]). Let 

U- : M ^ R be a weak KAM solution of negative type and consider 

Graph(77 + du^) :— {{x, r/{x) + dxU-), where dxU- exists}. 

Then: 

i) Graph(r7 + is compact and is contained in the energy level £* = 
{{x,p) e T*M : H{x,p) = a{c)}; 

ii) |^Graph(r/ + du^)j C Graph(?7 + c?tt_) for each t > 0; 

iii) M = TT ^Graph(77 + du^)j , where tt : T*M M is the canonical projec- 
tion. 

Moreover, let us define: 

T{u-) p) (Graph(7; + du_)) . 
t>o 

is non-empty, compact and invariant under . Furthermore, its "unstable 
set" contains Graph(77 + du^); i.e., 

Graph(r? + rf«_) C VF" {T{u^)) {(y,p) : dist(<i>^,(2/,p), o} . 

There is a relation between these invariant sets (or CJ*(m+)) and the 

Aubry set Ac (recall that 3*(w_), 3*(u+) C T*M, while Ac C TAf). 

Theorem 6.19. 

Al:=c[A}j = p) T{u^)= p) Graph(77 + dw_) = 

= f] 3*{u+)= f] Graph(?7 + du+) = 

(28) = f] {x e M : u-ix) ^u+{x)}, 

("-,"+) 

where C : TM — >■ T*M denotes the Legendre transform of L and [u_,u^) are con- 
jugates solutions. 

Since it is easier to work with subsolutions rather than weak solutions, we want 
to discuss now how ry-critical subsolutions, although they contain less dynamical 
information than weak KAM solutions, can be used to characterize Aubry and 
Mane sets in a similar way. 

Consider u -< L,, + a{c). For t > define 

3f (u) :— { (a;, ti) G TA/ : ^[x,v){s) '■= 7r<&f'((x, v)) is (u, L^, q;(c)) — calibr. on (— oo, t] } . 
We shall call the Aubry set of u: 3(u) := nt>o that can be also defined as 

3{u) := {{x,v) £ TM : J(x,v){s) ■= Tr^^{{x,v)) is {u,Ljj,a{c)) - calibr. on M} . 
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These sets 3{u) are non-empty, compact and invariant. Moreover, here are some 
properties of these sets (compare with theorem 6.18). 

Proposition 6.20. Let u -< L,-i + a{c). 

(1) 3t{u) is compact; 

(2) 3t'{u) C 5t(u) C 5o(u) for all t' > t > 0; 

(3) C (^3o{u)j is contained in the energy level £* corresponding to a{c); 

(4) C (5t(u)) C Graph(r/ + du) for all t > 0; 

(5) C ^3o(w)^ ^ Graph(77 + du) (observe that for weak solutions these two sets 
coincide ); 

(6) (5o(u)) = 3t{u) for all t > 0; 

(7) U>o5t(") =5o(u); 

(8) 3{u)^nt>o^'^t{M^)); 

(9) Mu) C W (jiu) 



(10) TT : 3{u) — > 7r(CJ(u)) is a hi-Lipschitz homeomorphism [Graph Theorem]. 
The same is true for 3t(u) for each t > 0. 



Theorem 6.21 (Fathi). The Aubry and Mane sets defined in (23) and (22) can 
he equivalently defined in the following ways: 

Ac ^ Pi 5(u) = Pi (Graph(r; + dw)) 

K = U 3{u). 

Moreover, there exists Uco ^ L^j + a{c) such that Ac = 3(uoo) H C^^ i^c)- 

The proof of this theorem follows from the results in |22| Chapter 9] . For the last 
statement is sufficient to observe that the set of critically dominated functions is a 
separable subset of C(M). Let be a countable dense family of such functions 
and define as a convex combination of their normalization (with respect to a 
fixed point Xn € M), e.g., u^oix) = J2'^=o ^ i'^n{x) - Un{xo)). 

Remark 6.22. Using this characterization, the graph property of the Aubry set 
(Theorem 5.301 follows easily from property (10) in Proposition 6.20 Moreover, 
the non-emptiness of A/'c is a result of the non-emptiness of 3{u). As far as the 
non-emptiness of Ac is concerned, one can deduce it from this characterization and 
proposition |6.33| 

From theorem |6.21| one can also deduce another interesting property of criti- 
cally dominated functions: their differentiability on the projected Aubry set (recall 
that a-priori these functions are only Lipschitz, so they are differentiable almost 
everywhere) . 

Proposition 6.23 (see |22l Theorem 4.3.8 (i)]). Let u ^ L^j + a{c). For each 
x e Ac, u is differentiable at x and d^u does not depend on u; namely, d^u = 

^ix,n-^[{x)). 

In addition to the Aubry set and Mane set, one can also recover the definition 
of Mane potential 4>n.a{c) (see Section js]) and Peierls barrier ft.^ (see (25l) in terms 
of these solutions and subsolutions. 
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Let us start by observing that, from definition 6.3 if u -< L,, + a{c) then for 
each x,y <E M and i > we have that u{y) — u{x) < hri,t{x,y) + a(c)t, where hrj^t 
is defined as 

h,j.t{x, y) = min L,j{-f{s),j{s)) ds , 
Jo 

where the minimum is taken over all piecewise paths 7 : [0, t] — > M , such 
that 7(0) = X and ^{t) = y. This minimum is achieved because of Tonelli theorem 



(Theorem 5.1 



This implies that for each u ^ L,, + a(c) and for each x,y £ M, u{y) — u{x) < 
h,,{x,y), i.e., 

(j^vMc) i^^ y) ^ sup [u{y) - u{x)] yx,y G M . 

One can actually show that they are equal. 

Proposition 6.24 (see [22, Corollary 9.1.3]). For each x,y £ M, we have the 
equality 

0r,.a(c)(a;, y) = sup [u{y) - u{x)] . 

Remark 6.25. The quantity on the right-hand side is also called viscosity semi- 
distance^^ (see [55] Section 8.4]). 

As far as Peierls barrier is concerned, let us observe that similarly to what 
happens for Mane potential, also in this case we have that for each u < L^j + a(c) 
and for each x,y € M, u(y) — u{x) < hrj{x,y), i.e., 

hr,{x,y)> sup [u{y)-u{x)] ^ x,y £ M . 

Moreover, if u_ e and m+ S 5+ are conjugate solutions, the same result 
holds: u_{y) — u^{x) < hjj(x,y) and consequently 

hr,{x,y)> sup [u-{y) ~ u+{x)] \/x,yeM, 

where (u_,u+) denotes conjugate weak KAM solutions. In addition to this, it is 
possible to show that the above inequality is actually an equality. In fact: 

Proposition 6.26 (see |18l Theoreme 7]). For x E M let us define the function 
: M -^R (resp. hr,,x : M -^R) by hf^{y) = h^{x,y) (resp. hr,^x{y) = /i,,(y, x)). 
For each x G M , the function hf-^ (resp. —h^ ,^) is a weak KAM solution of negative 
(resp. positive) type. Moreover, its conjugate function € (resp. ut_ S S~ ) 
vanishes at x. 

Therefore: 

Corollary 6.27. For each x,y € M, we have the equality 

hrj(x,y)^ sup [w_(y) - M+(x)] , 
("-,"+) 

where the supremum is taken over pairs of conjugate solutions. Moreover, for any 
given x,y £ M this supremum is actually attained. 

Observe that, since for any u -< + a(c) there exists a weak KAM solution 
of negative type m_ and a weak KAM solution of positive type u+, such that 
= u ^ on the projected Aubry set Ac (see Theorem 6.16), one can get 
the following representations for Peierls barrier on the projected Aubry set: 

(29) hn{x,y) = sup [u{y) ~ u{x)] 

for all x,y £ Ac. This supremum is actually attained for any fixed x G Ac. 
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Remark 6.28. In particular, (29 1 shows that Peierls barrier and Mane potential 



coincide on the projected Aubry set. 



ADDENDUM 



6. A - Regularity of critical subsolutions 

In this addendum we want to say more about the regularity of critically domi- 
nated functions or Ty-critical subsolutions. 

We have remarked above in this section, that for k < a{c) there do not exist 
functions dominated by + k, while for k > a{c) they do exist. Moreover, if 
k > a{c) these functions can be chosen to be C°° (see also characterization of a(c) 



in remark 6.8 1. The critical case has totally different features. As a counterpart 
of their relation with the dynamics of the system, critical dominated functions 
have very rigid structural properties, that become an obstacle when someone tries 
to make them smoother. For instance, as we have recalled in proposition |6.23| 
ii u ^ L^i + a(c) then its differential dxU exists on Ac and it is prescribed over 
there. This means that although it is quite easy to make these functions smoother 
{e.g., C°°) out of the projected Aubry set, it is impossible to modify them on this 
set. 

Nevertheless, Albert Fathi and Antonio Siconolfi managed to prove that 
/^-critical subsolutions do exist and are dense, in the following sense: 

Theorem 6.29 (Fathi, Siconolfi). Let u -< i,, + a(c). For each e > 0, there 
exists a function u : AI — > M such that: 

i) u ^ Ljj + a{c); 

ii) u(a;) = u{x) on Ac,' 

iii) \u{x) — u{x)\ < e on M \ Ac. 

Moreover, one can choose u so that it is a strict rj-critical subsolution, i.e., we have 
Hn{x,dxu) < a(c) on M\Ac. 

This result has been extended by Patrick Bernard [3], who showed that every 
ry-critical subsolution coincides, on the Aubry set, with a C^'^ ?7-critical subsolution. 

Theorem 6.30 (Bernard, [51). Let H be a Tonel li Hamiltonian. If the Hamilton- 
Jacobi equation has a subsolution, then it has a C^'^ subsolution. Moreover, the set 
giiljgolutions is dense for the uniform topology in the set of subsolutions. 

Remark 6.31. In general C^'^ is the best regularity that one can expect: it is easy 
in fact to construct examples in which ry-critical subsolutions do not exist. For 
example, consider the case in which the Aubry set projects over all the manifold 
M and it is not a graph {e.g., on M = T take L{x,v) — ^\\v\\^ + sin^(7rx) and 
r] = '^dx). In this case there is only one critical subsolution (up to constants), that 
is an actual solution: its differential is Lipschitz but not C^. 

It is therefore clear that the structure of the Aubry set plays a crucial role. Patrick 
Bernard [7] proved that if the Aubry set is a union of finitely many hyperbolic 
periodic orbits or hyperbolic fixed points, then smoother subsolutions can be con- 
structed. In particular, if the Hamiltonian is C'^, then these subsolutions will be 
C'^ too. The proof of this result is heavily based on the hyperbolic structure of 
the Aubry set and the result is deduced from the regularity of its local stable and 
unstable manifolds. 

See also [21] for a survey on this problem and some results concerning Denjoy-type 
obstructions for the existence of regular critical subsolutions on T^. 
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Using the density of critically dominated functions, one can emprove some 



of the results in (28 1, Theorem 6.21 and (29). Let us denote by the set of 
ry-critical subsolutions and 5,^'^ the set of C^^ 77-critical subsolutions. Then: 

X n = fl 3{u) = 

(30) = f] {Gi-aph{r] + du)) ^ f] (Graph(?7 + dw)) . 

In particular, there exists a C^'^ 77-critical subsolution u such that: 
Ac = C-'^ (Graph(?7 + du) D £*) = 

(31) = 5({t)n £-!(£::). 

Moreover, for any x, y £ Ac'- 

(32) h,,{x,y) = sup {ii(y) - u(x)} = sup {u{y) - u{x)} 
where all the above suprema are maxima for any fixed x,y G Ac- 



6.B - NON- WANDERING SET OF THE MANE SET 

In this addendum we want now to use this approach and the above-mentioned 
results to show that the non-wandering set of the Euler-Lagrange flow restricted to 



the Mane set is contained in the Aubry set (we mentioned this in Proposition 5.28 1 



Let us first recall the definition of non-wandering point for a flow $j : X — > X - 

Definition 6.32. A point x £ X is called non-wandering if for each neighborhood 
hi and each positive integer n, there exists t > n such that f*(U) HU =/= 0- 

We shall denote the set of non-wandering points for $j by il($t). 

Proposition 6.33. // M is a compact manifold and L a Tonelli Lagrangian on 
TM, then Q ($f |A/;) C Ac for each c e Hi(M;E). 

Remarks. 

1) Proposition 6.33 also shows that the Aubry set is non-empty. In fact, any 
continuous flow on a compact space possesses non- wandering points. 

2) Since every point in the support of an invariant measure is non-wandering, 
then this also shows that M.c C Re- 



proof. Let (x, v) eVL (^<I>f |7Vo j . By the definition of non- wandering point, there 
exist a sequence {xk,Vk) G A/'c and tk — !■ +00 , such that {xk,Vk) — t- {x,v) and 



^^^{xkjVk) — > (xyv) as A; — > +00- From (30l, for each {xk,Vk) there exists a 77 
critical subsolution Uk, such that the curve jk{t) — tt ($f (xfe, Vk)) is (ufc, L^, a{c)) - 
calibrated. Moreover, up to extracting a subsequence, we can assume that, on any 
compact interval, 7^ converge in the C^-topology to j{t) — tt ($f (a:,w)). 

Pick now any critical subsolution u. If we show that 7 is (u, L^, a(c)) - calibrated. 



using (30) we can conclude that {x,v) G Ac- First of all, observe that, by the 



continuity of u, 



70 



ALFONSO SORRENTINO 



Using that Ty-critical subsolutions are equi-Lipschitz (as remarked after definition 



6.3 1, we can also conclude that 



Uk{lk{tk)) - Uk{xk) 

and, therefore, 

(33) / Ljj{'jk{s),'jk{s)) + a{c)ds ^ Uk{jk{tk)) ~ Uk{xk) 

Jo 

Let < a < b and choose tk > b. Observe now that 

u{jk{b)) - u(7fc(a)) = u{'^k{tk)) ~ u[xk) ~ [u{'-fk{tk)) ~ u["fk{b))] - 

- [u{'-fk{a)) - u{xk)] > 



> u{jk{tk)) - u{xk) - Lrf{jk{s),^k{s))+a{c)ds- 

Jb 

Lnilk{s),ikis)) + a{c) ds = 
u{'^k{tk)) - u{xk) + / Lr^{'^k{s),ik{s)) + a{c)ds ~ 



L^{lk{s),ik{s)) +a{c) ds; 
taking the limit as fc cx) on both sides, one can conclude: 

u(7(6)) - u(7(a)) > / L^{-f{s),^{s)) +aic)ds 

J a 

and therefore, from the fact that u ^ Ljj + a(c), it follows the equality. This shows 
that 7 is (m, Lj,, a(c))-calibrated on [0, oo). To show that it is indeed calibrated on 
all M, one can make a symmetric argument, letting {yk, Wk) — {xk, Vk) play the 
role of {xk,Vk) in the previous argument. In fact, one has {yk,Wk) {x,v) and 
^-tkiVkiWk) — >■ {x,v) as k ^ +00 and the very same argument works. 

□ 
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